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SECTION  1 


INTRODUCTION  AND  SUMMARY 

INTRODUCTION 

The  research  effort  reported  herein  is  part  of  a continuing  effort  by 
the  Air  Force  Avionics  Laboratory  to  gain  information  on  operator  perfor- 
mance using  high  resolution,  ground  mapping,  synthetic  aperture  radar  sys- 
tems. Early  operator  performance  research  efforts  in  the  mid  - and  late 
1960s  were  directed  principally  towards  real-time  strike  of  large  fixed  tar- 
gets. In  the  early  and  mid-1970s,  the  research  shifted  towards  the  problems 
of  the  real-time,  tactical  target,  strike  mission.  This  change  of  emphasis 
was  due  to  the  technological  development  of  synthetic  aperture  radar  (SAR) 
which  has  made  the  imaging  of  small  tactical  targets  (e.  g. , tanks,  trucks, 
and  SAM  sites)  on  SAR  ground  maps  a reality. 

The  SAR  operator  performance  research  that  has  been  conducted  dur- 
ing the  past  10  years  has  been  oriented  towards  parametric  studies  of  radar 
system  parameters,  display  presentation  parameters,  types  of  briefing  and 
reference  material  aids,  types  of  strike  missions,  and  general  operator  per- 
formance estimation  (Hershberger  and  Carel,  1967;  Carel  and  Hershberger, 
1967;  Hershberger  and  Craig,  1970;  Hershberger  and  Craig,  1972;  Craig  and 
Hershberger,  1974).  Nearly  all  of  this  past  research  was  conducted  using 
single  operators  who  had  sole  responsibility  for  interpreting  the  radar  image, 
performing  radar  mode  switching  functions,  and  designating  the  radar  target 
aimpoint.  The  operators  in  the  research  studies  had  no  other  task  respon- 
sibility or  workload.  Past  research  has,  therefore,  implicitly  assumed  a 
multiple  crew  aircraft. 

The  radar  operators  in  past  SAR  operator  performance  research 
have  not  been  responsible  for  aircraft  flight  control  or  aircraft  systems 
management.  For  SAC,  this  assumption  is  valid;  for  TAC  where  both  single- 
and  two-seat  aircraft  could  be  used  for  all-weather  strike  missions  employ- 
ing an  advanced  air-to-ground  SAR  system,  the  assumption  is  not  necessarily 
valid. 
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By  1980,  the  principal  TAC  aircraft  which  might  be  considered  for 
a SAR  strike  system  are  the  F-4,  F-111,  F-15,  and  F-16.  Thus  TAC  might 
want  to  use  either  single-  or  two-seat  aircraft  with  a SAR  system.  For  TAC, 
then,  the  question  of  a single  pilot/radar  operator's  ability  to  both  control 
aircraft  systems  and  successfully  recognize  and  designate  radar  targets  in  a 
limited  time  profile  is  of  major  importance. 

The  issue  of  one-  versus  two-seat  strike  aircraft  has  been  argued  for 
many  years  by  both  Air  Force  and  Navy  air  forces  with  strong  advocates  for 
both  positions.  Surprisingly  little  definitive  work  has  been  done  to  resolve 
the  issue  of  one-  versus  two-man  air-to-ground  strike  aircraft.  The  most 
comprehensive  study  was  done  by  the  Boeing  Company  {1967  and  1968). 

Boeing  conducted  an  extensive  analysis  and  simulation  for  the  Navy's 
Multimission  Fighter/Attack  Aircraft  concept.  Advanced  system  concepts 
for  alternate  cockpit  configurations  of  one-  versus  two-place  multi-mission 
aircraft  for  the  1972-1975  time  period  were  evaluated.  The  results  of  the 
analysis  are  summarized  in  the  following  quotation: 

The  two-place  multi -mis  sion  fighter/attack  aircraft  system 
appears,  at  this  time,  to  provide  the  best  probability  of  mis- 
sion success.  Both  the  one-  and  two-man  configurations  appear 
satisfactory  for  successful  completion  of  the  multi -mis  sion 
role  under  normal  operating  conditions.  However,  the  two- 
place  has  advantages  if  degraded -mode  operations  are  required, 
and  could  improve  target  acquisition  performance  under  any 
mission  situation. 

The  Boeing  laboratory  simulation  compared  one-versus  two -place 
aircraft  for  the  primary  task  of  visual  ground  target  acquisition  with  second- 
ary tasks  of  flight  systems  management,  weapon  delivery,  and  navigation 
system  update.  The  results  revealed  that  the  two-man  crew  visually 
acquired  the  test  targets  at  a greater  range  than  one-man  crews.  There 
was  no  difference  in  probability  of  target  acquisition.  There  was  generally 
little  difference  between  the  one-  and  two-man  crews  in  the  secondary  per- 
formance measures. 

It  appears  from  the  Boeing  work  that  a two-man  crew  can  visually 
acquire  prebriefed  ground  targets  sooner  than  a one-man  crew  — about 
1 second  at  a 200  foot  altitude  and  Mach  0.9  aircraft  speed  — and  a two-man 


crew  offers  better  mission  reliability  that  the  one-man  crew  because  the 
second  man  can  share  tasks  when  failures  occur.  For  standard  flight  control 
and  aircraft  systems  management  tasks,  a one-man  crew  can  function  as 
effectively  as  a two-man  crew.  The  major  criticisms  of  the  Boeing  work 
were  the  lack  of  any  out-of-cockpit  visual  tasks  other  than  the  visual  target 
acquisition  task  and  the  failure  to  vary  crew  workload  in  a controlled  man- 
ner over  a large  range. 

The  Autonetics  Division  of  the  North  American  Rockwell  Corporation 
(1967)  did  an  analytical  study  of  one-man  crew  effectiveness  for  the  F-X 
fighter  aircraft.  Analytical  models  were  used  to  provide  quantitative  evalua- 
tion of  mission  effectiveness  for  fighter  screen,  point  intercept,  day  inter- 
diction, and  all-AVeather  strike  missions.  The  general  results  and  conclu- 
sions of  the  Autonetics  study  are  summarized  in  the  following  statements; 

1.  A one-man  F-X  system,  optimized  for  air-to-air  missions, 
will  be  able  to  perform  typical  air-to-ground  missions 
effectively. 

Z.  The  controls  and  displays  necessary  to  operate  and  monitor 
the  F-X  system  can  be  fitted  into  a one-man  cockpit. 

3.  The  performance  of  the  F-X  system  shows  reduced  dependence 
on  crew  size  and  crew  performance, 

4.  The  F-X  system  will  not  present  serious  problems  to  a one- 
man  crew  in  the  areas  of  preflight,  takeoff,  cruising  flight, 
or  approach  and  landing. 

5.  F-X  system  capability  and  flexibility  is  achieved  by  a high 
degree  of  utility  of  the  air-to-air  systems  in  all  modes, 
system  mode  centralization  and  display  information  integra- 
tion, and  by  increased  autoiriation  and  advanced  technology. 

The  Autonetics  study  concludes  that  a one-man  crew  will  be  able  to 
adequately  operate  the  F-X  aircraft  without  being  overloaded.  The  study  did 
not  consider  degraded  mode  operation.  An  interesting  side  light  of  the  study 
was  a series  of  interviews  with  Air  Force  combat  flying  personnel.  These 
people  stated  that  a two -man  crew  is  desirable  when: 

1.  flying  CAP  missions  for  extended  radar  detection  range, 

2.  flying  difficult  low  altitude  air-to-surface  missions  involving 
complex  manual  navigation,  and 

3.  partial  equipment  failures  occur  and  one  man  can  not  handle 
all  backup  modes. 
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Hughes  Aircraft  Company  (1969)  did  a one-man/two-man  tradeoff 
during  its  Phase  lA  work  on  the  F-15  aircraft.  The  conclusion  arrived  at 
during  this  study  was  that  two  men  could  more  fully  exploit  the  potential  of 
the  avionics  system  than  one  man.  However,  the  life  cycle  cost  impact  of 
the  additional  automatic  features  which  must  be  added  to  improve  the  perfor- 
mance of  a one-man  system  is  not  significant  when  compared  with  the  signifi- 
cant penalties  on  the  aircraft  of  adding  a second  man.  By  providing  target 
signature  to  B-scan  radar  presentation  using  a digitally  augmented  detection 
system,  automated  counter-countermeasures,  precision  inertial  navigation, 
and  a preset/cocked  system  concept,  Hughes  felt  that  the  workload  would  be 
small  enough  for  a one-man  crew  to  effectively  operate  the  F-15  aircraft. 
This  conclusion  was  substantiated  by  a comparison  of  F-15,  F-105,  and 
F-106  weapon  systems  in  which  it  was  determined  that  the  F-15,  which  com- 
bines the  capabilities  of  both  the  single-man  F-105  and  F-106  aircraft, 
would  be  no  more  complex,  and  in  many  instances,  simpler  to  operate  than 
either  of  these  systems. 

In  an  anonymous  Navy  position  paper  (1973),  the  merits  of  a two-seat 
versus  a single-seat  aircraft  for  air-to-air  combat  and  fleet  air  superiority 
are  discussed.  The  paper  extolls  the  virtues  of  the  two-seat  configuration 
as  summarized  in  the  following  quotation; 

The  two-seat  fighter  offers  significant  advantages  over  single 
seat  aircraft  in  both  short  range  air-to-air  combat  over  enemy 
territory  and  longer  range  fleet  air  superiority  encounters. 

The  air-combat  advantages  accrue  primarily  because  the  two- 
man  crew  can  sight  and  acquire  targets  quickly  while  main- 
taining six  o'clock  surveillance  and  SAM  lookout.  Fleet  air 
superiority  advantages  stem  from  the  ability  of  the  second 
crew  member  to  concentrate  attention  on  sophisticated  multiple 
target  threats  and  ECM  while  the  pilot  flies  the  aircraft  and 
maintains  the  essential  visual  surveillance. 

A two-man  crew  permits  a double  check  on  flight  procedures 
and  minimizes  diversion  of  pilot  attention  from  flying  the 
aircraft.  Dual  seat  aircraft  consequently  enjoy  a 2 to  1 
safety  improvement  over  single  seaters  in  Navy  experience. 

The  high  combat  kill  effectiveness  of  the  two-man  fighter  in 
Navy  missions  combined  with  low  losses  due  to  accidents  and 
enemy  action  make  the  second  seat  a good  investment  for  Navy 
fighter  aircraft. 


Actual  experience  with  two-place  versions  of  several  fighter  aircraft 
seems  to  refute  the  argument  of  a large  performance  penalty.  A good  illus- 
tration is  the  F- 1 06a/ F- 1 06B  experience.  To  provide  the  additional  seat, 
life-support  equipment,  dual  avionics,  and  structure,  the  F-106B  weighs 
900  pounds  more  in  the  combat  configuration  than  t he  F-106A.  In  this  con- 
figuration it  carries  200  pounds  less  fuel.  Interestingly,  because  of  its  longer 
canopy  and  therefore  better  fineness  ratio,  the  F-106B  burns  slightly  less 
fuel  and  thus  the  fuel  penalty  at  takeoff  is  cancelled  during  a typical  2 hour 
mission.  Except  for  a 2 knot  faster  final  approach  speed,  aerodynamic  per- 
formance of  the  F-106B  is  not  discernibly  different  from  the  F-106A.  Actual 
tech  order  figures  show  a weight  of  889  pounds  more  for  the  F-106B  with 
416  pounds  less  fuel.  The  two  place  F-15  weighs  800  pounds  more  than  the 
single  place  version  and  carries  the  same  amount  of  fuel.  The  two  place 
F-16  will  weigh  approximately  the  same  as  the  single-place  but  carry 
600  pounds  less  fuel. 

The  issue  of  aircrew  workload  in  tactical  strike,  attack,  and 
reconnaissance  missions  was  addressed  by  F.  ter  Braak  (1974)  in  terms  of 
physical,  mental,  psychological,  and  training  factors.  Comparing  one-  and 
two-man  crews,  F.  ter  Braak  states  that  the  physical  and  mental  workload 
factors  are  not  reduced  with  a two-man  crew  because  each  crewman  performs 
his  task  under  the  same  circumstances  as  a single  pilot  crew.  In  fact,  the 
need  for  crew  coordination  is  an  added  task  that  increases  workload  in  a two- 
man  aircraft.  The  psychological  factor  is  also  assumed  to  be  equivalent  for 
one-  and  two-man  aircrews.  In  general,  F.  ter  Braak  does  not  believe  there 
is  an  appreciable  difference  in  workload  between  one-  and  two -man  aircraft. 

The  five  papers  reviewed  in  the  preceding  pages  reveal  a wide  range 
of  opinions  regarding  the  benefits  of  a two-man  aircraft  compared  to  a single- 
man aircraft.  The  Boeing  study,  which  was  the  only  man-in-the-loop  simu- 
lation study,  found  target  acquisition  to  be  slightly  faster  (1  second)  with  the 
two-man  crew.  Autonetics  and  Hughes  analyses  support  the  contention  that 
with  proper  design  a single-seat  F-15  will  do  the  job:  hence  a second  crew- 
man is  not  required.  The  Navy  paper  advocates  a two-seat  aircraft  because 
of  the  higher  probability  of  detecting  and  countering  target  threats.  The 
analysis  of  crew  workload  by  F.  ter  Braak  concludes  that  adding  a second 
crewman  would  not  reduce  crew  workload. 

c. 


The  question  of  a single  pilot/radar  operator's  ability  to  both  control 
aircraft  systems  and  successfully  recognize  and  designate  radar  targets  in  a 
limited  time  profile  cannot  be  adequately  answered  from  existing  information. 
Therefore,  it  cannot,  with  little  risk,  be  stated  that  a SAR  should  be  used  in 
single-seat  aircraft. 

Clearly,  a pilot  in  a single-seat  aircraft  who  is  flying  on  autopilot  in 
a low  threat  environment  with  all  systems  working  properly  can  accomplish 
a SAR  air-to-ground  strike  mission  as  well  as  a pilot  and  weapons  system 
officer  in  a two-seat  aircraft.  The  potential  advantage  of  the  second  crew- 
man would  occur  in  high  workload  situations  and  high  threat  environments. 

No  known  research  has  quantitatively  addressed  the  issues  of  workload, 
outside  cockpit  threat  detection,  and  SAR  target  recognition  for  the  air-to- 
ground  strike  mission  with  one-  and  two-man  aircrews.  The  simulation 
study  described  in  this  report  was  therefore  conceived  to  address  these  issues 
and  provide  information  for  the  Air  Force  to  determine  if  SAR  systems  should 
be  placed  in  single-place  aircraft. 

SUMMARY 

A Tactical  Air  Command,  shallow  interdiction,  air-to-ground  strike 
mission  formed  the  structure  for  the  simulation  study.  Both  one-  and  two- 
man  crews  were  evaluated  during  three  phases  of  a 350-second  mission  that 
included  ingress,  penetration,  and  ground  target  acquisition.  The  ingress 
phase  lasted  40  seconds  and  simulated  the  time  required  to  reach  the  Forward 
Edge  of  the  Battle  Area.  The  penetration  phase  lasted  220  seconds  and  simu- 
lated the  traversing  of  hostile  territory  to  the  assigned  target  area.  The 
target  acquisition  phase  simulated  90  seconds  over  the  target  area  during 
which  the  crew  recognized  and  designated  the  prebriefed  ground  target. 

Two  cockpit  configurations  were  required  to  allow  the  assessment  of 
both  one-  and  two-man  crew  sizes.  In  the  one-man  crew  simulation,  all 
controls  and  displays  were  located  in  a single  cockpit,  while  in  the  two-man 
crew  simulation  the  controls  and  displays  were  divided  between  two  cockpits. 
Regardless  of  configuration,  however,  the  following  controls  and  displays 
were  functional: 


Multi -mode  CRT  Display 

Radar  Warning  Receiver  (RWR)  and  Threat  Bearing  Indicator 
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Countermeasures  Control  Panel 

Flight  Stick 

Throttle  and  Radar  Acquisition  Control 

Hack  Clock 

Communications  Controls. 

The  multi-mode  display  served  as  a Vertical  Situation  Display  (VSD) 
during  the  ingress  and  penetration  phases,  while  in  the  target  acquisition 
phase  it  presented  synthetic  aperture  radar  ground  map  video  and  simple 
flight  information.  The  Radar  Warning  Receiver  and  Threat  Bearing  Indica- 
tor alerted  the  crew  to  four  types  of  threats  and  indicated  the  relative  bear- 
ing of  each.  The  countermeasures  control  panel  provided  a means  for  the 
operator  to  respond  to  threats.  A standard  flight  stick  was  used  by  the  pilot 
to  control  the  pitch  and  roll  attitude  of  the  aircraft.  A throttle  provided  con- 
trol over  the  displayed  airspeed  of  the  aircraft  and  included  the  radar  acquisi- 
tion controls.  A Hack  clock  and  communications  controls  completed  the 
complement  of  controls  and  displays. 

The  two  cockpits  were  interfaced  to  a hybrid  computer  that  performed 
the  majority  of  the  simulation  including  aerodynamic  model,  radar  model, 
threat  scenario  logic,  and  symbolic  display  dynamics.  A stroke  symbol 
generator  and  an  in-raster  symbol  generator  produced  the  symbols  for  the 
vertical  situation  and  ground  map  displays,  respectively.  A television  cam- 
era and  light  box  arrangement  converted  the  SAR  ground  map  film  imagery 
to  video  form  for  display.  Through  appropriate  interface  equipment,  the 
computer  could  determine  the  positions  of  all  switches  and  controls  in  both 
cockpits  and  generate  the  required  displays. 

Surrounding  both  cockpits  were  180-degree  cylindrical  screens  on 
which  small  lights  were  mounted  to  simulate  outside-cockpit  threats.  Illum- 
ination of  the  lights  was  under  computer  control  and  determined  by  the  threat 
scenario.  Crew  responses  could  be  detected  by  the  computer  which  allowed 
automatic  data  collection. 

A crew  had  a number  of  tasks  they  were  required  to  perform  during 
the  mission.  These  included  the  following: 

Flight  control 

Air-to-air  radar  monitoring  and  target  lock-on 


7 


r 


Radar  warning  receiver  monitoring 

Countermeasures  activation 

Outside-cockpit  threat  detection 

Ground  map  radar  target  recognition  and  designation 

Communications  with  Airborne  Command  and  Control  Center  and 

second  crewman. 

One-  and  two-man  crews,  five  threat  densities  (workload)  from 
zero  to  an  average  of  14.  1 threats  per  minute,  and  the  three  mission  phases 
were  examined  using  a mixed -factor  factorial  design  and  a latin-square 
counterbalancing  of  ground  targets,  subjects,  and  threat  density  levels. 
Subjects  were  Tactical  Air  Command  Pilots  and  Weapon  Systems  Officers 
A total  of  20  crews  participated  — 10  single-man  and  10  two -man.  Flight 
control,  threat  detection  and  response,  and  ground  map  target  acquisition 
performance  were  measured. 

Crew  size  and  threat  density  affected  the  crews'  ability  to  control 
aircraft  altitude  and  heading,  as  shown  in  Figures  1 and  2.  At  zero  threat 
density,  one-  and  two -man  crews  were  equivalent.  As  threat  density  (work- 
load) increased,  flight  control  performance  degraded.  The  performance 
degradation  was  much  more  rapid  for  one-man  crews  than  for  two -man 
crews.  A larger  degradation  of  altitude  control  performance  compared  to 
heading  control  with  increased  threat  density  was  probably  due  to  the  greater 
importance  of  controlling  heading  to  arrive  at  the  ground  map  radar-turn-on 
point. 

The  four  types  of  threats  to  which  the  crews  were  required  to  respond 
during  the  simulation  were  categorized  into  threats  that  required  inside- 
cockpit  visual  tasks  and  outside- cockpit  visual  tasks.  Figure  3 shows  a 
comparison  of  in- cockpit  and  out-cockpit  threat  detection  performance  for 
one-  and  two-man  crews  at  various  threat  densities  during  the  SAR  target 
acquisition  mission  phase.  There  was  no  appreciable  difference  between 
one-  and  two-man  crews  for  inside-cockpit  threats,  except  at  the  highest 
threat  density  where  the  one-man  crews  were  better.  The  superiority  of  the 
one-man  crews  at  the  highest  threat  density  was  caused  by  a breakdown  in 
two-man  crew  task  coordination  in  the  SAR  target  acquisition  phase  which 


^ J 


8 


PERCENT 


THREAT  DENSITY,  AVERAGE  NUMBER  PER  MINUTE 


Figure  1.  Effects  of  threat  density 
and  crew  size  on  aircraft  altitude 
control  performance. 


Figure  2.  Effects  of  threat 
density  and  crew  size  on  air- 
craft heading  control 
performance. 


PROBABILITY  OF  THREAT  DETECTION  AND  RESPONSE 


caused  inside-cockpit  threat  detection  to  degrade  more  for  two-man  crews 
than  for  one-man  crews.  In  the  penetration  phase,  the  two-man  crews  were 
slightly  superior  to  the  one-crews  at  the  highest  threat  density. 

Two-man  crews  were  significantly  better  than  the  one-man  crews  in 
outside-cockpit  threat  detection.  Approximately  40  to  95  percent  more 
out  side- cockpit  threats  were  detected  by  the  two-man  crews  across  the  four 
threat  densities.  The  second  crewman  was  a decided  advantage  for  outside- 
cockpit  visual  surveillance. 

Crew  size  and  threat  density  effects  on  SAR  target  acquisition  time 
are  shown  in  Figure  4.  Less  time  was  required  by  the  two-man  crews 
except  at  the  highest  threat  density.  The  effects  of  crew  size  and  threat 
density  on  probability  of  correct  SAR  target  acquisition  are  shown  in  Fig- 
ure 5,  The  two -man  crews  again  were  superior  to  the  one-man  crews 
except  at  the  highest  threat  density. 

The  probable  reason  for  the  superior  performance  of  one-man  crews 
at  the  highest  threat  density  is  the  ignoring  of  outside -cockpit  threats  until 
the  SAR  target  acquisition  task  was  completed.  Though  one-man  crews  per- 
formed better  than  two -man  crews  at  the  highest  threat  density,  they  sacri- 
ficed outside -cockpit  threat  detection  to  do  so. 


THREAT  DENSITY  (AVERAGE  NUMBER  PER  M'NUTE) 
Figure  4.  Crew  size  and  threat  density  effects  on 
time  to  acquire  SAR  targets. 
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Figure  5.  Crew  size,  threat  density, 
and  probability  of  target  acquisition. 

In  general,  two-man  crews  were  superior  to  one-man  crews  at 
aircraft  flight  control,  outside-cockpit  threat  detection,  and  SAR  target 
acquisition  tasks.  The  dominant  superiority  of  two-man  crews,  however, 
was  for  outside-cockpit  threat  detection.  A major  advantage  for  a two-place 
SAR  air-to-ground  strike  aircraft,  therefore,  is  the  improved  visual  sur- 
veillance achieved  with  two  crewmen  and  the  resulting  increased  survivability 
when  over  hostile  enemy  territory. 
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SECTION  I 


SIMULATION  METHODOLOGY 


MISSION  PROFILES 

The  Tactical  Air  Command  (TAC)  shallow  interdiction  mission  shown 
in  Figure  6 provided  the  structure  for  the  simulation.  The  simulated  aircraft 
performed  the  strike  function,  and  an  imaginery  second  aircraft  acted  as 
wingman.  The  mission  was  functionally  divided  into  four  phases:  pre-mission 
loiter,  ingress,  penetration,  and  target  acquisition.  Data  were  collected 
during  the  last  three  of  these  phases.  The  total  mission  length  was 
350  seconds. 

During  the  pre-mission  phase,  the  simulated  aircraft  loitered  at 
10,  000  feet  altitude  and  300  knots  awaiting  strike  orders  from  the  Airborne 
Command  and  Control  Center  (ABCCC).  At  the  beginning  of  a simulation 
trial,  the  ABCCC  transmitted  verbal  descriptions  of  the  target  type,  target 
location,  and  target  aimpoint  as  well  as  target  area  geographical  features  of 
potential  use  in  recognizing  the  ground  target.  When  the  crew  acknowledged 
the  targeting  information,  the  ABCCC  directed  the  strike  aircraft  to  a 
specific  altitude,  airspeed,  and  course  to  intersect  the  ground  map  radar 
turn  on  point  (RTOP). 

The  ingress  phase  began  when  the  aircraft  departed  the  loiter  area 
on  a heading  to  the  target  area.  It  continued  for  40  seconds  and  simulated 
the  time  required  to  reach  the  Forward  Edge  of  the  Battle  Area  (FEBA). 

During  this  time  the  crew  established  the  correct  altitude,  heading,  and  air- 
speed as  directed  by  the  ABCCC.  As  the  aircraft  were  over  friendly  terri- 
tory during  this  phase,  no  threat  indications  were  received. 

The  penetration  phase  followed  the  ingress  phase  and  simulated  the 
traversing  of  hostile  territory  to  the  assigned  target  area.  This  phase  lasted 
for  245  seconds  during  which  the  crew  was  required  to  detect  and  respond  to 
threat  indications  as  well  as  perform  communications,  flight  control,  and 
navigation  functions. 
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Figure  6.  Shallow  interdiction  mission  profile. 


The  final  phase  was  the  SAR  target  acquisition  portion  of  the  mission 
This  phase  lasted  for  90  seconds  and  began  at  the  RTOP  w’hen  the  radar  auto 
matically  switched  to  the  ground  map  mode  of  operation.  The  crew  was 
required  to  recognize  and  designate  the  prebriefed  target  and  to  detect  and 
respond  to  threat  indications.  Flight  control  was  not  required,  however,  as 
the  autopilot  system  was  activated  during  this  phase. 

Both  one-  and  two-man  crews  were  evaluated  in  the  simulation.  The 
number  of  threat  indications  during  the  penetration  and  target  acquisition 
phases  were  varied  from  none  to  a total  of  74  threats  (zero  to  an  average  of 
14.  1 threats  per  minute).  These  threats  were  of  several  types  as  will  be 
detailed  later. 

COCKPIT  CONFIGURATIONS 

Because  both  one-  and  two-man  crews  were  to  be  evaluated,  the 
simulation  equipment  needed  two  cockpit  configurations.  In  the  one-man 
simulation,  all  controls  and  displays  were  located  in  a single  cockpit  so  that 
a single  operator  could  perform  all  mission  functions.  In  the  two-man 
simulation,  the  required  tasks  were  divided  between  the  operators,  and  the 
two  cockpits  reflected  this  division  by  the  controls  and  displays  used  in  each 
of  the  cockpits. 

One-man  Cockpit 

The  single-seat  cockpit  configuration  is  shown  in  Figure  7.  The 
major  displays  and  controls  in  this  cockpit  are: 

Multi-mode  Display 

Radar  Warning  Receiver  (RWR)  and  Threat  Bearing  Indicator 

Countermeasures  Control  Panel 

Flight  Stick 

Throttle  and  Radar  Acquisition  Control 

Hack  Clock 

Cof iimunications  Controls. 

The  following  paragraphs  detail  the  operation  of  each  of  these  components. 
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Multi -mode  display.  The  multi-mode  display  provided  the  primary 
means  of  communicating  dynamic  information  to  the  crew.  In  the  ingress 
and  penetration  phases  of  the  mission,  it  served  as  a Vertical  Situation  Dis- 
play (VSD)  while  in  the  target  acquisition  phase  it  presented  ground  map  radar 
and  simple  flight  information. 

Figure  8 shows  the  flight  and  navigation  symbology  displayed  prior 
to  the  RTOP.  The  vertical  scale  on  the  left  presented  aircraft  airspeed  in 
knots,  and  the  right-hand  scale  presented  altitude  in  thousands  of  feet.  Both 
of  these  scales  were  fixed  with  a moving  indicator.  A moving  scale,  fixed - 
pointer  presentation  of  heading  was  presented  across  the  top  of  the  display. 

A fixed  lubberline  in  the  center  of  the  display  represented  one's  own-ship, 
while  a moving  horizon  line  presented  attitude  information. 

The  two  digital  readouts  labeled  RNG  and  BRG  presented  range,  in 
nautical  miles,  and  relative  bearing  in  degrees,  to  the  RTOP.  The  bearing 
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Figure  8.  Flight  and  navigation  symbology  on 
multi-mode  display. 
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indication  functioned  in  the  same  way  as  an  Automatic  Direction  Finder  (ADF). 
These  two  readouts  provided  the  necessary  information  for  the  pilot  to  navi- 
gate a specific  track  to  the  RTOP. 

In  addition  to  flight  and  navigation  symbology,  the  multi -mode  display 
also  presented  air-to-air  radar  data.  Figure  9 is  similar  to  Figure  8 with 
air-to-air  radar  search  symbology  added.  The  vertical  line  represented  the 
azimuth  angle  of  the  radar  with  the  edge  of  the  display  representing  the 
±90  degree  limits  of  the  radar  scan  pattern.  The  small  tick  mark  near  the 
airspeed  scale  indicated  which  of  the  four  5-degree  elevation  bars  was  cur- 
rently being  scanned  by  the  antenna.  A cursor,  consisting  of  a pair  of  short 
vertical  lines,  could  be  controlled  by  the  operator  to  designate  air-to-air 
targets.  Figure  9 also  shows  the  return  from  two  air-to-air  targets.  These 
were  presented  in  a B-scan,  azimuth  versus  range,  format  with  targets 
appearing  as  a trail  of  returns.  This  latter  characteristic  resulted  from  the 
simulation  of  a digitally  scan-converted  radar  display  which  presented  16  sec- 
onds of  target  history.  Thus,  not  only  was  the  most  recent  return  displayed 
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Figure  9.  Air-to-air  radar  search  symbology  on 
multi-mode  display. 
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miles. 

Figure  10  depicts  the  multi-mode  display  with  the  air-to-air  radar 
locked -on  to  a target.  In  this  condition  the  azimuth  angle  indicator  and  all 
target  returns  were  removed  from  the  display  and  were  replaced  by  two 
horizontal  lines  representing  minimum  and  maximum  missile  launch  ranges. 
In  this  lock-on  mode  the  cursor  represented  the  range  of  the  target,  and  if  it 
was  within  range,  a missile  could  be  launched. 

At  the  RTOP,  the  radar  was  automatically  switched  to  the  ground 
mapping  mode  and  the  multi -mode  display  appeared  as  shown  in  Figure  11. 
Attitude  information  was  presented  superimposed  on  the  synthetic  aperture 
radar  (SAR)  imagery.  Pitch  and  roll  were  shown  by  artificial  horizon  and 
pitch  ladder  symbols.  A controllable  diamond  shaped  cursor  was  also 
displayed. 
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Figure  10.  Air-to-air  radar  lock-on  symbology  on 
multi-mode  display. 
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Figure  11.  Radar  video  and  symbology  on 
multi-mode  display. 

Radar  Warning  Receiver  and  Threat  Bearing  Indicator.  Figure  12 
details  the  radar  warning  receiver  (RWR)  panel  and  the  associated  threat 
bearing  indicator.  This  panel  alerted  the  crew  to  impending  and  actual 
threats.  The  four  indicators  on  the  right  of  the  panel  identified  the  type  of 
threat  as  SAM  (Launch).  SAM  (Tracking),  AAA,  or  AI.  In  addition  to  the 
illumination  of  an  indicator  light,  an  aural  tone  also  sounded  in  the  operator's 
headset.  A low  frequency  tone  indicated  a SAM  (Launch)  while  a high  fre- 
quency tone  indicated  one  of  the  other  three  threat  types.  For  each  threat 
indicated  by  a threat  type  light,  a small  light  was  also  illuminated  in  one  of 
the  12  possible  clock  positions  around  the  circular  threat  bearing  indicator 
shown  on  the  left  in  Figure  12.  These  small  lights  simulated  the  strobe  line 
indication  typical  of  actual  RWR  systems  and  provided  the  operator  with  the 
relative  bearing  of  the  threat. 
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Countermeasures  Control 


Panel.  The  countermeasures  con- 
trol panel,  shown  in  Figure  13,  pro- 
vided a means  for  the  operator  to 
respond  to  threats.  This  panel  had 
four  switches  for  activating  the 
required  countermeasure.  The 
JAM  button  was  the  correct  response 
for  both  SAM  indications,  CHAFF 
countered  AAA,  and  FLARE  can- 
celled AI  indications.  The  fourth 
button  would  fire  a missile  if  the 
air-to-air  radar  was  locked -on  to 
a target.  If  a missile  was  launched 
against  a target  beyond  its  range,  the  target  would  remain  and  the  radar 
would  continue  in  the  lock-on  mode.  If  the  target  was  in  range,  then  after  a 
delay  simulating  the  flight  of  the  missile  the  target  would  be  removed,  and 
the  radar  would  return  to  the  search  mode. 

The  length  of  time  a particular  threat  type  indication  remained  active 
depended  on  the  operator's  response  and  the  mission  scenario.  In  the 
absence  of  any  response  or  an  incorrect  response  from  the  operator,  the 
scenario  would  call  for  a threat  to  remain  active  for  a randomly  determined 
time  between  15  and  ZO  seconds.  If  the  operator  made  a correct  response, 
the  threat  type  light  and  the  associated  tone  would  extinguish  3 seconds  later. 


Figure  12.  Radar  warning  receiver 
and  threat  bearing  indicator. 


Figure  13.  Countermeasures  control  panel. 
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Flight  Stick.  A standard  flight  stick  was  used  by  the  pilot  to  control 
the  pitch  and  roll  attitude  of  <^he  aircraft.  No  trim  control  was  provided. 

Throttle  and  Radar  Acquisition  Controls.  A throttle  was  located  on 
the  left-hand  side  console  and  provided  control  over  the  displayed  airspeed 
of  the  aircraft.  Because  it  was  necessary  for  the  threat  density  (threats  per 
unit  of  time)  to  remain  constant  for  any  given  threat  level,  the  time  of  each 
mission  phase  needed  to  remain  fixed.  This  was  accomplished  by  always 
keeping  the  ground  speed  and  the  distances  to  the  FEBA  and  RTOP  constant. 
The  pilot  could  adjust  the  displayed  airspeed  which  he  believed  also  changed 
the  ground  speed. 

The  radar  acquisition  controls  were  mounted  on  the  throttle.  These 
consisted  of  a combination  force  control  and  acquisition  switch,  and  a break - 
lock  switch.  The  force  control  was  mounted  such  that  it  was  easily  activated 
with  the  second  finger  of  the  left  hand  while  gripping  the  throttle.  The  force 
control  action  positioned  the  cursor  on  the  display  by  controlling  the  rate 
and  direction  of  cursor  movement. 

When  the  cursor  was  positioned  according  to  the  operator's  desires, 
he  could  squeeze  and  release  the  force  control  to  command  the  radar  to  the 
acquisition  mode.  In  this  mode  the  radar  antenna  rapidly  scanned  all  four 
elevation  bars  and  a 10-degree  azimuth  area  centered  around  the  cursor 
position.  If  a target  return  was  received  within  the  area  defined  by  the  cur- 
sor, the  radar  transitioned  to  the  lock -on  mode.  If  no  return  was  received, 
or  one  was  not  within  the  cursor  gate,  the  radar  returned  to  the  search  mode 
after  5 seconds. 

The  break-lock  switch  was  located  on  the  throttle  under  the  first 
finger.  If  the  radar  was  locked  onto  a target,  actuation  of  this  switch  caused 
the  radar  to  return  to  the  search  mode. 


Hack  Clock.  A hack  clock  was  available  for  the  crew  to  use  in  what- 
ever manner  they  chose. 
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Communications  Controls.  Controls  were  provided  to  allow  the  crew 
to  adjust  the  audio  gain  to  the  head-set.  Also  provided  was  a mute  switch 
that  automatically  reduced  the  audio  gain  to  a low  level.  The  communications 
channel  included  a link  to  the  ABCCC,  typical  wide  area  background  commu- 
nications activity  and,  in  the  two -man  case,  intercom. 

Two -man  Cockpit 

In  the  two -man  configuration,  a second  cockpit  was  added  to  the 
simulation  to  accommodate  the  Weapons  System  Officer  (WSO).  Both  cock- 
pits are  shown  in  Figure  14.  The  controls  and  displays  in  the  front  cockpit 
remained  the  same  as  in  the  one-man  case  with  two  exceptions.  The  Radar 
Warning  Receiver  and  Threat  Bearing  Indicator  were  removed  and  the  radar 
controls  were  deactivated. 

The  rear-cockpit  was  equipped  with  a Multi-mode  Display,  Radar 
Warning  Receiver  and  Threat  Bearing  Indicator,  Hack  Clock,  and  Communi- 
cations controls  that  functioned  in  the  same  manner  as  in  the  single-seat 
configuration.  The  radar  cursor  control,  lock-on,  and  break-lock  functions 
in  the  rear-seat  were  accomplished  using  the  center-mounted  hand  control 
and  associated  switches.  The  rear-seat  cursor  control  was  a first-order 
O'"  position  control  rather  than  a rate  control  as  in  the  front  cockpit. 

Lock-on  in  the  rear-seat  was  accomplished  using  the  hand  control  mounted 
trigger  switch  and  break-lock  was  activated  by  the  top  thumb  switch  on  the 
control. 

SIMULATION  EQUIPMENT 

The  two  cockpits  were  interfaced  to  a hybrid  computer  and  other 
equipment  as  shown  in  block  diagram  form  in  Figure  15.  A Xerox  Data 
Systems  9300  digital  computer  and  an  Applied  Dynamics  .\D-4  analog  com- 
puter formed  a hybrid  computer  system  that  performed  the  majority  of  the 
simulation,  including  aerodynamic  model,  radar  model,  threat  scenario 
logic,  and  symbolic  display  dynamics,  A stroke  symbol  generator  and  an 
in-raster  symbol  generator  produced  the  symbols  for  the  vertical  situation 
and  ground  map  displays,  respectively.  A television  camera  and  light  box 
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arrangement  converted  the  radar  group  map  film  imagery  to  video  form  for 
display.  Through  appropriate  interface  equipment,  the  computer  could  deter- 
mine the  positions  of  all  switches  and  controls  in  both  cockpits  and  generate 
the  required  displays. 

Surrounding  both  cockpits  were  180-degree  cylindrical  screens  on 
which  small  lights  were  mounted.  These  screens  extended  from  the 
11  o'clock  to  the  5 o'clock  positions  with  a high,  lov',  ird  level  light  at  each 
position.  The  21  lights  served  to  simulate  outside  cockpit  "hreats.  Illumina- 
tion of  the  lights  was  under  computer  control  and  determined  by  the  threat 
scenario.  The  screen  and  a few  of  the  lights  can  be  seen  in  Figure  16.  Clock 
positions  6 to  10  were  not  simulated  as  they  were  the  responsibility  of  the 
imaginery  wingman  as  indicated  in  Figure  16. 

All  crew  responses  could  be  detected  by  the  computer  except  the 
detection  of  the  outside  threats.  The  operator's  response  to  these  was  a 
verbal  call-out.  To  get  this  information  into  the  computer  so  it  could  be 
recorded  along  with  other  responses  required  that  an  experimenter  press 
a button  indicating  the  clock  position  called  out.  These  buttons  were  located 
on  a small  panel  behind  the  front  cockpit.  This  panel  can  be  seen  in 
Figure  16. 


WINGMAN 


Figure  16.  Outside-cockpit  threat  set-up. 
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The  simulation  software  was  designed  to  allow  the  maximum  flexibility 
in  threat  scenario  definition.  This  was  accomplished  by  having  the  computer 
read  a set  of  scenario  definition  cards  at  the  beginning  of  each  simulation  run. 
These  cards  specified  a time  into  the  mission  at  which  a particular  threat  was 
to  be  activated  or  deactivated.  The  possible  threats  were  air-to-air  radar, 
RWR,  and  outside  cockpit  lights. 

For  the  air-to-air  radar  threats,  a total  of  16  possible  targets,  each 
with  a different  heading  and  speed,  could  be  selected.  At  any  given  time  a 
maximum  of  four  air-to-air  radar  targets  could  be  active. 

Four  possible  RWR  threat  types  could  be  specified:  SAM  (Tracking), 
SAM  (Launch),  AAA,  and  AI.  The  bearing  of  the  threat  and  whether  an  out- 
side light  should  be  associated  with  RWR  threats  was  specified  for  each  RWR 
threat.  An  outside  light  was  illuminated  for  all  RV/R  threats  between  11  and 
5 o"clock  unless  the  threat  type  was  a SAM  (Tracking).  A specification  of 
High,  Level,  or  Low  was  also  input  for  the  outside  light.  Outside  lights  could 
be  activated  and  deactivated  in  association  with  a RWR  threat  or  independently 
as  non-RWR  threats. 

Data  collection  was  performed  automatically  by  the  computer.  All 
pertinent  information  about  the  simulation  and  the  operator's  responses  were 
stored  ZO  times  a second.  When  a full  second  of  data  had  accumulated,  it 
was  written  onto  magnetic  tape.  This  tape  was  later  used  by  another  program 
to  assess  performance. 


OPERATOR  TASKS 

The  crew  had  a number  of  tasks  they  were  required  to  perform  during 
the  mission.  These  included  the  following: 

Flight  control 

Air-to-air  radar  monitoring  and  target  lock -on 
Radar  warning  receiver  monitoring 
Countermeasures  activation 
Outside-cockpit  threat  detection 
Ground  map  radar  target  designation 
Communications  with  ABCCC  and  second  crewman. 
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The  flight  control  task  required  the  operator  to  maintain  an  assigned  altitude, 
heading,  and  airspeed.  To  make  the  task  slightly  more  demanding,  no  trim 
was  available  and  the  aircraft  had  a tendency  to  roll  in  one  direction  or  the 
other.  The  air-to-air  radar  task  required  the  crew  to  detect  air-to-air  tar- 
gets, coordinate  with  ABCCC  concerning  their  status  as  hostiles  or  friendlies, 
acquire  and  lock-on  to  hostiles,  and  fire  a missile  when  in  range.  The  pro- 
cedures for  accomplishing  these  tasks  have  been  described  previously. 

A majority  of  the  threats  appeared  as  indications  on  the  radar  warning 
receiver  display  panel  and  associated  threat  bearing  indicator.  As  described 
earlier,  four  threat  types  could  be  displayed.  These  were  SAM  (Launch), 

SAM  (Tracking),  AAA,  and  AI.  The  crew  was  cued  to  one  of  these  threats 
by  an  audio  tone  in  their  headset  in  addition  to  the  presence  of  the  threat  type 
indication.  The  operator's  task  was  to  detect  the  threat  and  its  type  then 
examine  the  threat  bearing  indicator  to  determine  the  clock  position  of  the 
threat.  In  situations  where  many  threats  were  present,  this  required  the 
operator  to  remember  which  threat  bearing  lights  had  already  been  illumi- 
nated. The  operator  then  verbalized  the  threat  in  the  following  format  "Sam 
launch  at  3 o'clock".  Along  with  this  verbalization,  the  crew  member  can- 
celled the  threat  by  activating  the  appropriate  countermeasure.  The  correct 
responses  were: 


Threat  Type 
SAM  (Launch) 
SAM  (Tracking) 
AAA 
AI 


Countermeasure 

JAM 

JAM 

CHAFF 

FLARE. 
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A slight  modification  to  the  RWR  threat  procedure  given  above  occurred 
in  the  two-man  case  because  of  the  particular  cockpit  configuration.  The 
rear-seat  had  the  RWR  display  panel  but  the  front  seat  had  the  countermea- 
sures control  panel.  Because  of  this,  the  WSO  was  required  to  ask  the  pilot 
for  the  desired  countermeasure.  Both  crew  members  heard  the  audio  tone. 
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If  the  threat  type  was  any  other  than  a SAM  (Tracking)  and  it's  bearing 
indication  was  between  11  and  5 o'clock,  the  operator  examined  the  outside 
lights  at  the  appropriate  bearing  to  discern  whether  it  was  high,  level,  or 
low.  When  he  found  the  position  he  called  out  in  the  following  manner;  "three 
o'clock  light  on."  If  the  threat  type  was  a SAM  (Tracking)  no  outside  light 
was  illuminated.  Similarly,  if  the  threat  was  between  6 and  10  o'clock,  it  was 
the  responsibility  of  his  imaginery  wingman  and  no  outside  light  appeared. 

Not  all  outside  lights  were  cued  by  RWR  indications.  Non-RWR  out- 
side lights  could  also  occur  at  any  time  which  required  the  crew  to  scan  out- 
side the  cockpit  for  any  new  lights  that  had  come  on.  The  response  was  the 
same  as  for  RWR  outside  lights  and  required  a call-out  of  bearing  and  alti- 
tude (high,  level,  or  low).  The  operators  were  also  asked  to  call  any  lights 
that  had  extinguished;  although  these  data  were  not  analyzed. 

One  nautical  mile  prior  to  the  RTOP  the  aircraft  was  placed  in  auto- 
pilot to  remove  the  flight  task  requirement  during  SAR  target  acquisition.  At 
the  RTOP,  the  radar  automatically  switched  to  the  ground  map  mode  and  the 
crew  searched  for  the  target.  The  target  was  prebriefed  and  its  coordinates 
known,  thus  the  operator  correlated  the  displayed  video  with  his  map  to  detect 
the  target.  Acquisition  was  accomplished  by  moving  a cursor  over  the  target 
and  activating  the  lock-on  switch.  If  the  first  designation  was  deemed  by  the 
crew  member  to  be  incorrect,  activation  of  the  break -lock  switch  allowed 
redesignation.  The  radar  controls  were  the  same  as  for  the  air-to-air  mode. 

The  final  task  required  of  the  crew  was  communication  with  the  ABCCC. 
This  consisted  of  receiving  ground  target  information,  air-to-air  target  IFF 
data,  and  navigation  information  if  the  aircraft  strayed  too  far  from  course. 

In  the  two -man  configuration,  additional  communication  was  required  of  the 
crew  members  to  coordinate  their  efforts. 

RESEARCH  DESIGN 

A mixed-factor  factorial  design  was  used  to  assess  the  effects  of  crew- 
size,  threat  density,  and  mission  phase.  Because  each  subject  was  required 
to  be  in  only  one  crew  size,  this  variable  was  between-subjects.  All  threat 
densities  and  mission  phases  were  seen  by  every  subject;  hence,  these  were 
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within-subject  variables.  A latin-square  technique  was  used  to  counter-balance 
ground  targets,  subjects,  and  threat  density  levels.  This  counter-balancing 
reduced  the  effect  of  any  transfer  resulting  from  one  condition  preceding  or 
following  another. 

Variable  Levels 

Two  crew  sizes,  five  threat  densities,  and  three  mission  phases 
were  examined.  Across  the  five  threat  densities,  the  total  number  of  threats 
varied  from  0 to  74.  The  exact  distributions  of  these  threats  by  type  and 
mission  phase  are  detailed  in  Figure  17. 

Subjects 

Subjects  were  Tactical  Air  Command  Pilots  and  Weapon  Systems 
Officers.  A total  of  20  crews  participated,  10  single-man  and  10  two-man. 

In  the  case  of  two-man  crews  both  members  had  previously  worked  together 
as  crews  in  F-111,  F-105G,  RF-4C,  or  F-4  aircraft.  One-man  crews  were 
pilots  of  A- 7 or  F-104  aircraft.  All  the  crews  were  composed  of  highly 
skilled  instructors  with  combat  experience. 


Mission  Phase 

Total 

Average 

Number 

per 

Minute 

Ingress 

Penetration 

Target  Acquisition 

Threat  Type 

Threat  Type 

Threat  Type 

Threat 

Level 

SAM  (L) 

SAM  (T) 

AAA 

►H 

< 

NON-RWR 

A/A 

SAM  (L) 

SAM  (T) 

AAA 

< 

NON-RWR 

V/V 

SAM  (L) 

SAM  (T) 

AAA 

t-H 

< 

NON-RWR 

A/A  1 

1 

None 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

■> 

None 

1 

1 

4 

6 

4 

3 

> 

> 

> 

1 

0 

38 

5.  5 
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6 

1 

9 

7 

8 

4 

0 

6 

1 

0 

3 

0 

46 

8.  6 

4 

None 

3 

5 

10 

13 

U 

8 

4 

1 

4 

> 

0 

0 

63 

13.  3 

5 

None 

6 

5 

6 

17 

15 

10 

3 

1 

7 

» 

> 

0 

74 

14.  1 

Figure  17.  Threat  densities  and  distributions. 
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Performance  Measures 


The  performance  measures  fall  into  three  major  categories  —flight 
control,  threat  detection  and  response,  and  SAR  ground  map  target  acquisi- 
tion. However,  because  of  the  distribution  of  tasks  across  mission  phases, 
not  all  measures  were  available  in  every  phase.  For  example,  ground  target 
acquisition  occurred  only  during  the  last  phase  of  the  mission. 

Aircraft  flight  control  was  measured  as  percent  of  the  time  the  alti- 
tude and  heading  were  within  a specified  tolerance.  The  tolerance  for  altitude 
was  ±1000  feet  and  for  heading  it  was  ±5  degrees.  Flight  control  performance 
was  not  measured  during  the  target  acquisition  phase  because  the  autopilot 
was  engaged. 

Threat  detection  was  measured  as  the  probability  of  correct  response. 
Probabilities  were  calculated  for  RWR  inside-cockpit  responses,  RWR  out- 
side lights,  non-RWR  outside  lights,  and  air-to-air  radar  targets.  No 
threats  occurred  during  the  ingress  phase,  so  these  probabilities  were  cal- 
culated for  the  last  two  phases  only.  For  SAR  ground  target  acquisition  the 
probability  of  correct  target  acquisition  and  the  time  required  for  acquisition 
were  measured. 

PROCEDURES 

In  the  simulation  study,  each  crew  received  a total  of  ten  test  and  five 
training  trials.  The  training  and  test  trials  were  given  in  three,  two-hour 
blocks  over  a one -and -a -half  day  period.  Prior  to  beginning  the  training 
trials,  each  crew  received  a 90-minute  briefing  which  described  in  detail  the 
purpose  and  objectives  of  the  study  program.  This  briefing  included  a demon- 
stration of  the  cockpit  simulators  where  each  crew  member  received  practice 
trials  flying  the  simulator  and  working  the  displays  and  controls. 

The  90-minute  briefing  followed  the  outline  below: 

• Program  introduction  which  covered  the  current  SAR  state 
of  the  art 

• The  program  approach  which  discussed  the  application  of 
SAR  to  the  TAG  mission  and  in  particular  the  shallow 
interdiction  mission 

• A walkthrough  demonstration  of  the  cockpit  simulator 
discussing  the  various  elements  of  the  simulator  that 
would  be  active  in  the  simulation 


• A detailed  discussion  of  the  displays  and  controls 

• The  simulation  mission  objectives  in  terms  of  the  navigation/ 
penetration  task  and  various  threat  defenses  that  would  be 
encountered 

• A discussion  of  the  various  threats 

• Threat  responses  required  by  the  crew  to  negate  a 
particular  threat 

• Crew  task  responsibilities  for  two-man  crews 

• A review  of  high  resolution  SAR  imagery 

• A discussion  of  the  target  recognition/designation  task  in 
the  SAR  ground  map  mode. 

A standardized  set  of  written  instructions  summarizing  air-to-air, 

RWR  and  Non-RWR  threats  and  the  appropriate  countermeasures  were  read 
by  each  crew  member.  These  instructions  were  as  follows: 

Air-to-Air  Radar 
General 

• Display  shows  radar  hits  on  A/A  targets 

• Targets  can  be  enemy  or  friendly 

• ABCCC  will  sometimes  give  target  location  and  IFF 
data 

Operator  Responses 

• In  two-man  cockpit  either  operator  can  detect  targets; 
however,  only  rear-seat  operator  can  designate  A/A 
targets. 

• If  target  is  a threat  to  you  (based  on  range  and  intercept 
angle),  place  cursor  over  radar  return  and  depress  and 
release  cursor  control  (puts  radar  in  super  search  mode), 
lock-on  to  target  and  launch  air-to-air  missile  ("Missile" 
pushbutton  on  countermeasures  panel).  Missile  flight 
time  averages  6 seconds. 

• In  two-man  cockpit,  pilot  fires  missile  on  command 
from  WSO. 

• Range  of  air-to-air  missiles  is  20  miles. 

• Don't  use  missiles  unless  deemed  necessary. 
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RWR  Threats 


r 


General 


Four  types  of  threats; 

SAM  (tracking) 

SAM  (launch) 

AAA 

AI 

• Aural  tone  occurs  with  RWR  threats. 

• SAM  track,  AAA  and  AI  have  same  tone. 

• SAM  launch  has  different  tone. 

• Bearing  indicators  light  up  for  all  RWR  targets. 

• Lights  between  11:00  and  5:00  positions  are  your 
responsibility. 

• Lights  between  6:00  and  10:00  positions  are  wingman's 
responsibility. 

• Outside  lights,  11:00  to  5:00  at  high,  level  and  low 
positions,  light  up  for  all  SAM  launch,  AAA,  and  AI 
threats. 

£e  erator  Responses 

• For  any  RWR  threat,  regardless  of  its  position;  1)  acti- 
vate appropriate  countermeasure; 

SAM  track  — Jam 
SAM  launch  — Jam 
AAA  - Chaff 
AI  — Flares 

and  2)  call  out  threat  type  and  bearing. 

• For  all  RWR  threats  between  11:00  and  5:00,  search  for 
outside  light.  When  outside  light  is  detected,  call  out 
position,  i.e.,  bearing  (11:00  to  5:00)  and  altitude 
(high,  level,  or  low). 

• Outside  lights  will  be  illuminated  for  15  to  Z5  seconds. 
When  light  extinguishes  call  out  bearing  and  altitude 
of  the  extinguished  light  (e.  g. , "Z  o'clock  low  light 
out"). 
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In  the  two -man  crew  condition,  the  RWR  threat  type  display  and 
bearing  indicator  were  active  in  the  rear-seat.  The  countermeasure  panel 
was  active  in  the  front  seat.  Therefore,  for  a particular  RWR  threat,  the 
WSO  was  required  to  identify  the  threat  type  and  relative  bearing  and  request 
the  appropriate  ECM  action  to  be  made  by  the  pilot. 

Non-RWR  Threats 


General 


• Non-RWR  threats  are  outside  lights  (between  11:00  and 
5:00  at  high,  level,  and  low  positions). 

• No  aural  or  threat  type  indication  will  occur  to  warn 
you  of  the  occurrence  of  a non-RWR  threat.  Thus,  you 
must  periodically  scan  the  outside  lights  to  detect  non- 
RWR  threats. 

Operator  Respons es 


• When  you  detect  a non-RWR  threat,  call  out  its  position 
(bearing  and  altitude)  e.  g. , "Light  at  4 o'clock  low," 

• Non-RWR  threats  will  be  illuminated  for  15  to 
25  seconds. 

• When  the  light  extinguishes,  call  out  bearing  and  altitude 
of  the  extinguished  light  (e.  g. , 4 o'clock  low  light  out). 

Upon  completion  of  the  verbal  briefing,  each  crew  received  a 
15-minute  familiarization  session  in  the  cockpit  simulator.  This  session 
was  intended  to  familiarize  the  crew  with  the  operation  of  the  various  dis- 
plays and  controls.  The  test  conductor  requested  that  specific  heading, 
altitude,  and  airspeed  be  maintained.  During  this  practice  flight,  several 
air-to-air  targets  were  introduced  which  allowed  the  appropriate  crew  mem- 
ber (front  seat  in  the  single-seat,  and  rear-seat  operator  in  two-seat  con- 
figuration) to  practice  target  lock-on  and  missile  fire.  Each  crew  flew  two 
short  missions  where  the  only  tasks  involved  were  flying  the  aircraft  and 
working  the  air-to-air  radar. 

At  this  time  the  crew  returned  to  the  briefing  where  any  questions 
were  answered.  The  test  conductor  spent  approximately  5 minutes  reviewing 
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procedures.  The  crews  were  assigned  the  call  sign  "RINGO"  and  were 
reminded  to  coordinate  all  air-to-air  missile  firing  with  the  ABCCC  "Allen 
Control". 

Following  the  final  briefing,  one  crew  began  the  first  training  mission 
in  the  simulator.  Prior  to  each  trial  the  crew  checked  the  status  of  all 
important  displays  and  controls  using  a checklist  provided.  These  lists  are 
reproduced  below. 

Single -Seat  Aircraft,  Cockpit  Initialization  Checklist 
Vertical  Situation  Display 
Power  — On 

Symbol  Brightness  — Adjust  for  Comfort 
Video  Brightness  — Set  to  Mid-Range 
Video  Contrast  — Set  to  Mid-Range 

Radar  System 

Power  — Operate 

^ Mode  — A/A 

I Elevation  Bars  — 4 

' Azimuth  Scan  — ±90° 

Range  — 40  NM 

: Store  Time  — 16  seconds 

I Throttle 

I 

J 

! Position  — Set  to  Loiter  Speed  (300  knots) 

Autopilot  — Off 

Communications  System 

; Headset  — On  and  Working 

Volume  — Adjust  as  desired 
Mute  — Off 

I RWR  Display 

Threat  Type  Plaques  — Off 
Bearing  Lights  — Off 


Hack  Clock 


Wound  i 

Reset  I 

\ 

Targeting  Package  ‘ 

1:50,  000  Scale  Chart  ^ 

Two -Seat  Aircraft,  Cockpit  Initialization  Checklist 
Radar  Display 
Front  Seat 

Powe  r — On 

Symbol  Brightness  — Adjust  for  Comfort 
Video  Brightness  — Set  to  Mid-Range 
Video  Contrast  — Set  to  Mid-Range 

Rear  Seat 

Mode  — Operate 

Video  Brightness  — Adjust  to  Comfort 
Video  Contrast  — Set  to  Mid-Range 

Radar  System 

Front  Seat 

Power  — Operate  i 

Mode  — A/A 
Elevation  Bars  — 4 
Azimuth  Scan  — ±90° 

Range  — 40  NM  ; 

Store  Time  — 16  seconds 

Rear  Seat 

Mode  — Operate 
Elevation  Bars  — 4 

Azimuth  Scan  — ±90°  i 

Range  — 40  NM 


I 
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Throttle 


Front  Seat 

Position  — Set  to  Loiter  Speed  (300  knots) 
Autopilot  — Off 

Rear  Seat 


Cursor  Control  Mode  — TID  Cursor 
Conrtmunications  System 
Front  Seat 

Headset  — On  and  Working 
Volume  — Adjust  as  Desired 
Mute  — Off 

Rear  Seat 

Headset  — On  and  Working 
Volume  — Adjust  as  Desired 
Mute  — Off 

RWR  Display 

Front  Seat 

Threat  Type  Plaques  — Off 
Bearing  Lights  — Off 

Rear  Seat 

Threat  Type  Plaques  — Off 
Bearing  Lights  — Off 

Hack  Clock 

Front  Seat 

Wound 

Reset 

Rear  Seat 


Wound 

Reset 
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Targeting  Package 
Front  Seat 

1:50,  000  Scale  Chart 
Rear  Seat 

1:50,  000  Scale  Chart 

The  five  training  trials  were  given  in  order  of  increasing  workload. 
For  the  one-man  crews,  the  pilot/WSO  was  handed  a map  chip  (1:50,  000  AMS 
topographic  chart)  annotated  with  an  "X"  inside  a scribed  1.  5 by  1.5  nautical 
mile  box.  The  "X"  indicated  where  the  target  was  or  had  been  located,  while 
the  box  indicated  the  amount  of  ground  that  would  be  covered  by  the  radar  but 
not  necessarily  the  exact  coverage  that  would  be  displayed.  The  operator 
was  allowed  to  study  the  chart  for  approximately  20  seconds  during  which 
time  he  familiarized  himself  with  the  terrain  and  any  contextual  cues  in  the 
area.  At  this  time  "ALLEN  Control"  contacted  "RINGO"  flight  as  follows. 

"Ringo  flight,  this  is  ALLEN  control,  I have  a target,  request  an 
immediate  strike.  Target  is  a convoy  of  10  tanks  moving  south-southwest 
at  coordinates  PV155830.  Target  is  1000  meters  west  of  the  town  of  HULLEN 
approaching  bridge  at  PV  153820.  Strike  lead  vehicle.  Do  you  copy?" 

"Roger  ALLEN"  (RINGO  reads  back  target  data).  The  operators  then  spent 
an  additional  20  to  3 0 seconds  studying  the  map  chip  and  making  annotations 
as  required.  "ALLEN  Control"  then  directed  the  crew  to  fly  a particular 
altitude,  heading,  and  airspeed  to  intercept  the  desired  radar-turn-on  point 
(RTOP).  After  the  crew  had  acknowledged  the  flight  profile  data,  the  mis- 
sion began.  The  crew's  tasks  were  to  fly  the  aircraft,  monitor  the  air-to- 
air  radar,  monitor  RWR  threats,  take  countermeasure  action,  monitor  out- 
side RWR  and  non-RWR  threats,  and  perform  target  recognition  and 
designation  on  a high  resolution  SAR  ground  map. 

As  previously  discussed,  the  training  trials  were  given  in  order  of 
increasing  workload  level  (threat  density).  As  each  training  trial  was  com- 
pleted, a short  critique  was  given  by  the  test  conductor.  The  critique  was 
given  primarily  to  reinforce  consistent  responses  among  crews.  Each  crew 
was  given  a 5 to  7 minute  break  between  training  trials. 


- 
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Following  the  five  training  trials,  the  ten  test  trials  were  given.  The 
procedures  for  the  test  trials  were  identical  to  the  training  trials  except  that 
the  crews  were  not  told  which  threat  density  to  expect. 

GROUND  MAP  RADAR  IMAGERY 

High  resolution  synthetic  aperture  radar  imagery  was  used  in  the 
simulation.  The  radar  imagery  used  was  recorded  during  a military  exer- 
cise conducted  in  1974.  The  radar  imagery  was  of  excellent  quality  and 
sampled  a variety  of  tactical  targets  in  typical  scenarios.  The  radar  had 
a displayed  resolution  of  20  feet  and  a 1.  5 nautical  mile  square  coverage. 

A total  of  ten  test  and  five  training  targets  were  selected  as  test 
material.  Figure  18  shows  two  of  the  targets  used  in  the  simulation.  A 
description  and  picture  of  the  10  test  targets  used  is  presented  in 
Appendix  A. 


a.  Vehicle  convoy 

Figure  18.  Two  examples  of  SAR  target  scenes. 
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SECTION  3 

RESULTS  AND  DISCUSSION 

Crew  size  (one-  and  two-man  crews),  workload  (threat  densities 
averaging  from  zero  to  14.  1 (threats  per  minute),  and  mission  phase 
(ingress,  penetration,  and  SAR  target  acquisition)  were  study  parameters  in  the 
simulation.  Eight  different  performance  measures  were  used  to  assess 
the  effects  of  the  study  parameters  on  aircrew  performance. 

The  results  of  the  simulation  are  organized  by  category  of  aircrew 
performance  measures;  namely,  aircraft  flight  control  performance,  threat 
detection  and  response  (workload)  performance,  and  SAR  ground  map  tar- 
get acquisition  performance.  The  effects  of  the  three  study  parameters 
are  discussed  in  each  of  the  three  categories  of  performance  measures. 

The  results  are  depicted  graphically  in  plots  which  use  means  as  central 
tendency  descriptive  statistics  with  the  exception  of  SAR  target  acquisition 
time  which  uses  the  median.  Analysis  of  variance  was  used  to  test  for  the 
reliability  of  the  effects  of  the  study  parameters  on  the  various  measures  of 
operator  performance.  When  a probability  value  is  stated  for  a given  para- 
meter and  performance  measure  (e.g. , p<0.  01),  it  means  that  the  per- 
formance difference (s)  would  be  expected  to  occur  by  chance  with  the  stated 
probability  (e.g.  , L-s  than  one  chance  out  ox  a 100).  Analysis  of  variance 
summary  tables  are  in  Appendix  B. 

AIRCRAFT  FLIGHT  CONTROL  PERFORMANCE 

The  pilots’  ability  to  control  aircraft  altitude  within  ±1000  feet  of 
the  commanded  altitude  and  aircraft  heading  within  ±5  degrees  of  the  com- 
manded heading  during  the  ingress  and  penetration  phases  was  assessed. 

During  the  ingress  phase,  there  were  no  threats,  thus  workload  was  at  a 
minimum.  During  the  penetration  phase,  threat  density  (workload)  was 
varied  from  zero  to  14.  1 threats  per  minute.  When  the  radar  turn-on  point 
was  reached,  the  pilot  selected  autopilot,  thus  flight  control  performance  was 
not  assessed  during  the  SAR  target  acquisition  phase. 
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The  effects  of  crew  size  on  aircraft  altitude  and  heading  control  for 
the  i^ngress  and  penetration  phases  are  shown  in  Figures  19  and  20.  It  is 
clear  that  there  is  no  difference  in  a one-  or  two-man  crew's  ability  to 
pilot  the  aircraft  in  the  ingress  phase  where  the  workload  is  low.  The  two- 
man  crew,  however,  was  superior  to  the  one-man  crew  in  the  penetration 
phase  where  target  threats  were  introduced  to  increase  crew  workload. 

The  two-man  crews  were  able  to  control  altitude  within  ±1000  feet  96  per- 
cent of  the  penetration  phase  compared  to  7 8 percent  for  the  one-man  crews. 
Heading  control  during  the  penetration  phase  suffered  less  performance 
degradation;  although,  the  two- man  crews  were  definitely  better  than  the 
one-man  crews.  The  two-man  crews  were  within  the  ±5  degrees  tolerance 
99  percent  of  the  time  compared  to  92  percent  of  the  time  for  the  one-man 
crews. 

The  larger  degradation  of  altitude  control  contrasted  with  heading 
control  in  the  one-man,  two-man  comparison  is  probably  caused  by  the  pilots' 
interpretation  of  the  relative  importance  of  controlling  the  two  flight 
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parameters.  The  simulated  mission  was  flown  at  10,  000  feet  altitude. 
Deviation  from  this  altitude  by  as  much  as  4000  feet  would  have  little  effect 
on  mission  success.  Large  errors  in  heading  control,  however,  could  affect 
mission  success.  In  order  for  the  SAR  to  map  the  required  target  area,  the 
aircraft  had  to  be  within  ±5  degrees  of  the  required  heading  at  the  radar 
turn- on- point.  This  was  emphasized  to  the  pilots  during  training.  It  was, 
therefore,  likely  that  the  pilots  paid  more  attention  to  heading  control  than 
altitude  control.  Thus  when  threats  were  introduced  in  the  penetration  phase 
and  workload  became  large,  the  pilots  devoted  more  time  to  heading  control 
and  hence  degradation  of  heading  control  performance  was  less  than  for 
altitude  control. 

The  performance  differences  due  to  crew  size  and  mission  phase  on 
altitude  control  were  statistically  reliable  beyond  the  0.  01  probability  level, 
as  was  the  interaction  between  crew  size  and  mission  phase.  For  heading 
control,  performance  differences  due  to  crew  size,  mission  phase,  and  the 
interaction  between  crew  size  and  mission  phase  were  statistically  reliable 
beyond  at  the  0.  05,  0.  01,  and  0.05  probability  levels,  respectively. 

Figure  21  shows  the  effect  of  threat  density  and  crew  size  on  aircraft 
altitude  control.  The  degradation  of  aircraft  altitude  control  with  increased 
threat  density  was  much  more  severe  for  the  one-man  crews  than  the  two- 
man  crews.  There  was  very  little  performance  loss  with  the  two- man 
crews  until  threat  density  reached  12,  2 threats  per  minute.  At  the  highest 
threat  density,  altitude  control  performance  was  within  the  ±1000  feet 
tolerance  92  percent  of  the  time  for  the  two-man  crews.  For  the  one-man 
crews,  altitude  control  performance  ranged  from  100  percent  at  zero  threats 
to  68  percent  at  the  highest  threat  density.  Two- man  crews  were  clearly 
superior  to  one-man  crews  in  the  control  of  aircraft  altitude  with  increased 
workload,  and  the  heavier  the  workload  the  greater  was  the  benefit  of  having  a 
a second  crewman. 

The  effects  of  threat  density  on  one-  and  two-man  crews'  aircraft 
heading  control  performance  were  smaller  than  for  altitude  control.  Fig- 
ure 22  shows  that  performance  for  the  two-man  crews  was  affected  only  at 
the  highest  threat  density.  Heading  control  performance  was  affected  at  all 
threat  densities  for  the  one-man  crews,  although  the  performance  degradation 
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PERCENT  OF  TIME  WITHIN  ± 5 DEGREES  PERCENT  OF  TIME  WITHIN  ^ 1000  FEET 


was  not  great.  As  previously  discussed,  the  smaller  degradation  of  heading 
control  compared  to  altitude  control  with  increased  threat  density  was  prob- 
ably due  to  the  perceived  relative  importance  of  controlling  the  two  flight 
parameters  during  the  simulation. 

THREAT  DETECTION  AND  RESPONSE  PERFORMANCE 

The  one-  and  two-man  TAC  crews  were  required  to  make  four  types 
of  responses  to  the  simulated  threats  during  the  missions.  The  number  of 
threats  that  occurred  during  the  penetration  and  SAR  target  phases  were 
varied  from  zero  to  14.  1 threats  per  minute  to  vary  the  crews'  workload. 
There  were  never  any  threats  in  the  ingress  phase.  The  four  types  of 
responses  were  1)  detection  of  threat  indications  on  the  RWR  display  and 
activating  the  correct  countermeasures  (RWR  threat  response),  2)  detection 
of  RWR  outside  lights  and  calling  out  the  location  (altitude)  of  the  lights, 

3)  detection  of  non- RWR  outside  lights  and  calling  out  the  location  (bearing 
and  altitude)  of  the  lights,  and  4)  detecting,  designating,  and  launching  mis- 
siles against  air-to-air  radar  targets.  The  RWR  threat  response  and  air- 
to-air  radar  target  threats  were  in-cockpit  visual  tasks;  the  RWR  and 
non-RWR  outside  light  threats  were  out- of- cockpit  visual  tasks. 

RWR  Threat  Response 

Crew  size  had  no  effect  on  the  probability  of  correctly  responding  to 
RWR  threats  (p  > 0.  25 ) as  shown  in  Figure  23.  A statistically  reliable 
(p  < 0.  05)  interaction  between  mission  phase  and  threat  density  is  depicted  in 
Figure  24.  Two  effects  are  apparent  from  Figure  24.  As  threat  density 
increased,  the  probability  of  correct  RWR  threat  response  decreased,  and 
while  RWR  threat  response  performance  for  the  two  mission  phases  was 
near ly  equivalent  at  5,  5 threats  per  minute,  performance  degraded  more 
rapidly  in  the  SAR  target  acquisition  phase  at  the  higher  threat  densities. 

The  greater  and  more  rapid  fall  off  of  RWR  threat  response  per- 
formance in  the  SAR  target  acquisition  phase  is  probably  because  the  task 
of  locating  and  designating  the  target  on  the  SAR  ground  map  required  more 
time  and  attention  than  the  aircraft  flight  control  task  that  took  place  in  the 
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Figure  23.  Crew  size 
effects  on  RWR  threat 
response  performance. 


Figure  24.  Threat  density  and 
mission  phase  effects  on  RWR 
threat  response  performance. 


penetration  phase.  In  other  words,  the  SAR  target  acquisition  task  was  mere 
demanding  than  the  flight  control  task.  Hence,  there  was  less  time  for  the 
crews  to  respond  to  RWR  threats  in  the  SAR  target  acquisition  phase,  and 
at  the  higher  threat  densities,  performance  degraded  more  rapidly. 

The  degradation  of  RWR  threat  response  performance  with  increased 
threat  density  was  anticipated;  however,  it  was  also  anticipated  that  the  two- 
man  crews  would  suffer  less  performance  degradation  than  the  one-man  crews. 
This  was  not  the  case.  The  two-man  crews  were  not  substantially  better 
at  RWR  threat  detection  and  response  than  were  the  one-man  crews,  regard- 
less of  the  threat  density  or  the  mission  phase. 

RWR  Outside  Light  Detection 

After  a crewman  had  detected  a RWR  threat  and  activated  the  appro- 
priate countermeasure,  he  was  to  look  outside  the  cockpit  (if  the  threat 
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bearing  indicated  on  the  RWR  display  was  between  the  eleven  and  five  o'clock 
positions)  and  determine  the  altitude  (high,  level,  or  low)  of  the  outside  light. 

The  number  of  RWR  outside  lights  that  were  detected  by  the  crews 
was  affected  by  crew  size,  mission  phase,  and  threat  density.  All  three 
parameters  had  statistically  reliable  effects  on  RWR  outside  light  detection 
(crew  s ize,  p < 0.  05 ; mission  phase,  p < 0.  001 ; and  threat  density,  p < 0.  00 1 ). 
There  were  no  statistically  reliable  interactions  among  the  three  para- 
meters (p  > 0.  20  in  all  cases). 

Figure  25  shows  the  effect  of  crew  size  on  RWR  outside  light  detec- 
tion; 52  percent  of  the  lights  were  detected  by  one-man  crews  and  7 0 percent 
by  the  two-man  crews.  The  addition  of  a second  crewman  resulted  in  a 35  per 
cent  improvement  of  outside  light  detection  performance. 

The  probability  of  outside  light  detection  in  the  penetration  and  SAR 
target  acquisition  phases  is  shown  in  26.  As  was  the  case  for  aircraft  flight 


ONE-MAN  TWO-MAN  PENETRATION  SAR  TARGET 

ACOUISmON 

CREW  SIZE  MISSION  PHASE 


u 


Figure  25.  Effect  of 
crew  size  on  RWR 
outside  light 
detection 
performance. 


Figure  26.  Mission 
phase  effects  on 
RWR  outside  light 
detection 
performance. 


i 

i 

I 

f control,  performance  was  poorer  in  the  SAR  target  acquisition  phase  than 

the  penetration  phase  --  0.  56  versus  0.  66  probability  of  detection. 

As  threat  density  increased  from  5.  5 to  14.  1 threats  per  minute  the 
probability  of  RWR  outside  light  detection  decreased  from  0.  7 3 to  0.49. 

This  effect  is  illustrated  in  Figure  27  which  shows  threat  density  to  have  an 
approximately  linear  effect  on  RWR  outside  light  detection  performance. 

The  amount  of  time  available  to  the  crews  to  look  outside  the  cockpit 
to  determine  the  altitude  of  the  RWR  outside  lights  was  less  in  the  SAR 
target  acquisition  phase  and  decreased  as  threat  density  increased,  and  the 
addition  of  a second  crewman  resulted  in  there  being  more  time  available  to 
detect  the  lights.  The  performance  improvement  gained  with  the  second 
crewman  was  approximately  constant  across  all  threat  densities, 

Non-RWR  Outside  Light  Detection 

Whereas  RWR  outside  lights  were  cued  by  the  RWR  display,  non- 
RWR  outside  lights  were  not.  To  detect  non-RWR  outside  lights,  the  crews 

had  to  periodically  search  the  outside 
lights  and  call  out  the  bearing  and 
altitude  of  any  illuminated  lights. 

Crew  size  had  a major  effect  on 
the  probability  of  detection  of  non-RWR 
outside  lights  (p  < 0.  001 ).  As  shown 
in  Figure  28,  the  probability  of  detect- 
ing non-RWR  lights  was  0.  35  for  one- 

man  crews  and  0.  62  for  two-man  crews.  I 

a 

The  addition  of  a second  crewman  I 

resulted  in  a major  increase  in  the  time 

available  to  search  outside  the  cockpit  ' 

and  detect  non-RWR  lights. 

Although  slightly  more  non-RW'R 
lights  were  detected  in  the  SAR  target 
acquisition  phase  than  the  penetration 
phase  --  detection  probabilities  of  0.5  1 
and  0.46  --  the  performance 
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Figure  27.  RWR  outside 
light  detection  perfor- 
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difference  was  not  statistically  reliable  (p  > 0.  25).  Therefore,  it  must  be 
concluded  that  there  was  no  difference  in  the  probability  of  non-RWR  outside 
light  detection  between  the  two  mission  phases.  Figure  29  shows  the  small 
difference  due  to  mission  phase. 

The  effect  of  threat  density  on  non-RWR  outside  light  detection  is 
shown  in  Figure  30.  The  effect  was  statistically  reliable  at  the  0.  001 
probability  level.  As  shown  in  Figure  30,  detection  probability  dropped  from 
0.  57  at  8.  6 threats  per  minute  to  0.  39  at  12.2  threats  per  minute.  Detec- 
tion probability  remained  essentially  constant  between  the  two  lowest  threat 
densities  and  between  the  two  highest  densities.  The  slight  increases  in 
detection  probability  seen  in  Figure  30  were  not  statistically  reliable 
(p  > 0.  25),  Increasing  threat  density  from  5.  5 to  8.  6 threats  per  minute  or 
from  12.  2 to  14,  1 threats  per  minute  apparently  did  not  substantially  change 
the  crews'  workload  with  regard  to  non-RWR  outside  light  detection.  The 
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increase  from  8.  6 to  12.2  threats  per  minute,  however,  caused  a large  step 
increase  in  workload,  and  non-RWR  outside  light  detection  performance 
dropped  sharply. 


Air-to-Air  Radar  Target  Threats 


Air-to-air  radar  targets  were  presented  on  the  vertical  situation 
display  during  the  penetration  mission  phase.  The  radar  was  in  the  ground 
map  mode  during  the  SAR  target  acquisition  phase;  therefore,  air-to-air 
radar  target  threats  did  not  occur  in  that  phase.  If  a crewman  detected  an 
air-to-air  radar  target  that  was  within  20-nautical  miles  range  on  the  vertical 
situation  display,  he  designated  the  target  and  commanded  radar  super- 
search. When  radar  lock-on  occurred,  tin  air-to-air  missile  was  launched. 

There  was  no  difference  in  one-  and  two-man  crews  ability  to  respond 
to  air-to-air  radar  threats,  regardless  of  threat  density.  Figure  31  shows 
the  main  effect  of  crew  size  in  which  both  one-  and  two-man  crews  had  a 
0.  54  probability  of  detection. 
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Figure  31.  Effect  of  crew  size  on  air- 
to-air  radar  threat  detection 
performance. 


PROBABILITY  OF  A/A  RADAR  TARGET  THREAT  DETECTION 


Since  the  pilot  monitored  the  VSD  to  control  aircraft  flight 
performance  and  air-to-air  targets  were  presented  on  the  VSD,  the  addition 
of  a second  crewman  to  search  for  air-to-air  radar  targets  would  not  be 
expected  to  result  in  much  improvement  in  air-to-air  radar  target  detection 
performance.  The  typical  division  of  responsibilities  of  two- man  crews  in 
the  penetration  phase  was  for  the  pilot  to  handle  flight  control  and  air-to- 
air  radar  targets  and  the  second  crewman  to  handle  RWR  and  non-RWR 
threat  detection.  With  such  a division  of  tasks,  one  would  not  expect  any 
substantial  improvement  in  air-to-air  radar  target  detection,  but  a substan- 
tial improvement  in  the  detection  of  RWR  and  non-RWR  outside  lights  could 
be  expected.  Both  these  expectations  occurred. 

As  was  the  case  with  flight  control  performance,  RWR  threat 


response,  detection  of  RWR  outside  lights,  and  detection  of  non-RWR  outside 
lights,  increased  threat  density  resulted  in  decreased  aircrew  performance. 
Figure  32  illustrates  the  performance  degrading  effect  of  increased  threat 
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Figure  32.  Effect  of  threat  density 
on  air-to-air  radar  target  threat 
detection  performance. 


density  on  air-to-air  radar  target 
detection  performance.  Per- 
formance ranged  from  a 0.  77 
probability  of  detection  at  5.  5 
threats  per  minute  to  0.  38  prob- 
ability of  detection  at  14.  1 threats 
per  minute.  There  was  no  appre- 
ciable change  in  performance 
between  threat  densities  of  5.  5 
and  8.  6 threats  per  minute. 

Comparison  >f  Inside  and  Outside 
Cockpit  Threat  Response 
Performance 

The  four  types  of  threats 
that  occurred  during  the  simula- 
tion can  be  categorized  into  threats 
that  required  in- cockpit  monitor- 
ing and  threats  that  required 
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outside- cockpit  monitoring.  In  the  penetration  mission  phase,  RWR  threat 
response  and  air-to-air  radar  targets  required  in-cockpit  monitoring;  RWR 
and  non-RWR  outside  lights  required  outside- cockpit  monitoring.  In  the  SAR 
target  acquisition  mission  phase,  RWR  threat  response  required  in-cockpit 
monitoring;  RWR  and  non-RWR  outside  lights  required  outside- cockpit 
monitoring. 

Figure  33  shows  the  comparison  of  inside-cockpit  threats  and  outside- 
cockpit  threats  for  one-  and  two-man  crews  and  the  four  threat  densities  for 
the  penetration  phase.  It  is  clear  that  the  principal  benefit  of  a second 
crewman  for  threat  detection  and  response  performance  is  for  the  outside- 
cockpit  threats.  The  second  crewman  reduces  the  crew  workload  such  that 
more  time  is  available  to  search  outside  the  cockpit.  The  two-man  crews 
detected  35  to  78  percent  more  outside  cockpit  threats  across  the  four  threat 
densities  than  did  the  one-man  crews.  On  average,  the  two-man  crews' 
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Figure  33.  Comparison  of  inside-  and  outside- cockpit  threats  for 
one-  and  two-man  crews  and  threat  densities  in  the  penetration 
mission  phase. 
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outside  light  detection  performance  was  53  percent  better  than  the  one-man 
crews'  performance. 

For  inside-cockpit  threats  the  one-man  crews  were  negligibly  better 
than  the  two-man  crews  at  the  two  lowest  threat  densities.  At  the  two  high- 
est threat  densities,  the  two-man  crews  were  superior.  Thus  while  crew 
size  had  a major  effect  on  outside  cockpit  threats  at  all  threat  densities, 
the  benefits  of  a second  crewman  only  occurred  at  high  threat  densities  for 
inside-cockpit  threats. 

The  comparison  of  inside-  and  outside- cockpit  threat  detection  and 
response  performance  during  the  SAR  target  acquisition  phase  is  shown  in 
Figure  34.  Again,  the  two-man  crews  were  highly  superior  to  the  one-man 
crews  in  outside- cockpit  threat  detection. 
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Figure  34.  Comparison  of  inside-  and  outside- cockpit  threats  for 
one-  and  two-man  crews  and  threat  densities  in  the  SAR  target 
acquisition  mission  phase. 
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The  performance  differences  between  one-  and  two-man  crews  for 
inside-cockpit  threats  were  negligible  except  at  the  highest  threat  density 
level.  At  the  highest  threat  density,  one-man  crews  detected  more  inside- 
cockpit  threats  than  did  the  two  man  crews.  This  seemingly  odd  finding  was 
probably  a consequence  of  high  workload  and  a crew  coordination  problem. 

The  simulation  was  set  up  such  that  with  two- man  crews  the  rear- 
seat  operator  had  a RWR  display  but  not  a countermeasures  control  panel. 

The  pilot  in  the  front  seat  had  a countermeasures  control  panel  but  not  a 
RWR  display.  Thus,  the  rear- seat  operator  had  to  tell  the  pilot  the  type  of 
RWR  threat  that  had  been  encountered  in  order  for  the  pilot  to  initiate  the 
appropriate  countermeasure  response.  The  simulation  was  deliberately  set 
up  this  way  to  force  verbal  communications  and  task  coordination  in  the  two- 
man  crews,  knowing  that  such  a scheme  was  poor  cockpit  design. 

The  arrangement  worked  satisfactorily  except  at  the  highest  threat 
density  in  the  SAR  target  acquisition  phase.  In  the  SAR  target  acquisition 
phase,  the  rear- seat  operator's  principal  task  was  to  locate  and  designate 
a target  on  the  SAR  ground  map.  Monitoring  the  RWR  display  to  determine 
the  type  of  RWR  threat  and  communicate  this  to  the  pilot  was  an  additional 
task  imposed  on  the  rear- seat  operator.  The  rear- seat  operators  apparently 
were  able  to  handle  both  tasks  adequately  except  at  the  highest  threat  den- 
sity where  the  workload  became  too  great  and  performance  broke  down  as 
evidenced  by  the  poor  in- cockpit  threat  detection  performance. 


Overall  Threat  Detection  and  Response  Performance 

Figure  35  shows  threat  detection  and  response  performance  taken 
across  the  four  types  of  threats  for  one-  and  two-man  crews,  threat  densi- 
ties, and  mission  phases.  Two-man  crews  were  better  able  to  handle  the 
increased  workload  resulting  from  threat  density.  On  average,  the  two-man 

crews  detected  24  percent  more  threats  than  did  the  one-man  crews.  This  ! 

24  percent  performance  advantage  was  fairly  constant  across  all  threat 
densities  in  both  mission  phases. 

i 
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The  major  performance  difference  between  the  penetration  and  SAR 
target  acquisition  mission  phases  was  the  rate  of  performance  degradation 
with  increased  threat  density.  Performance  degraded  in  a linear  fashion  in 
the  penetration  phase  with  increased  threat  density.  In  the  SAR  target 
acquisition  phase,  performance  degradation  with  increased  threat  density 
was  a quadratic  function. 

The  difference  in  threat  detection  and  response  performance  degrada- 
tion caused  by  threat  density  for  the  two  mission  phases  is  probably  due  to 
nature  of  the  operators'  division  of  attention  among  tasks.  In  the  penetra- 
tion phase,  the  crews  were  required  to  control  the  aircraft  and  respond  to 
threats.  The  flight  control  task  required  continuous  or  regularly  periodic 
attention  to  keep  aircraft  altitude  and  heading  within  the  tolerances,  regard- 
less of  threat  density.  Since  the  pilot  tried  to  maintain  the  same  degree  of 
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Figure  35.  Overall  effects  of  threat  density  on  threat  detection 
and  response  performance. 
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aircraft  control  at  all  threat  densities,  threat  detection  and  response 
performance  degraded  in  a linear  manner  as  threat  density  increased. 

In  the  SAR  target  acquisition  phase,  the  crews  were  required  to 
recognize  and  designate  a target  on  the  SAR  ground  map  and  respond  to  threats. 
The  SAR  target  recognition  and  designation  task  did  not  require  either  con- 
tinuous or  periodic  attention  of  the  operator.  The  rear-seat  operator  could 
spend  a block  time  of  variable  length  on  the  SAR  target  recognition  and 
designation  task  without  serious  consequences.  Thus,  if  the  threat  response 
requirement  became  high,  the  rear- seat  operator  could  interrupt  the  SAR 
target  recognition  and  designation  task  to  help  the  pilot  deal  with  the  threat 
workload.  At  some  point,  however,  too  frequent  interruption  of  the  SAR 
target  acquisition  task  will  result  in  reduced  efficiency  and  degraded  per- 
formance, At  that  point,  the  rear-seat  operator  has  to  decide  whether  to 
help  the  pilot  deal  with  the  threats  and  risk  overflying  the  ground  target  before 
weapon  delivery  or  concentrate  on  the  SAR  target  recognition  and  designation 
task.  Since  the  prime  mission  objective  was  air-to-ground  strike,  the 
likely  result  is  a concentration  on  the  SAR  target  recognition  and  designa- 
tion task.  This  would  explain  why  threat  detection  and  response  performance 
fell  off  so  rapidly  at  the  two  highest  threat  densities  in  the  SAR  target 
acquisition  phase. 

SAR  GROUND  MAP  TARGET  ACQUISITION  PERFORMANCE 

Time  from  SAR  turn-on  until  the  rear- seat  operator  designated  the 
target  and  probability  of  correct  target  recognition  and  designation  were 
measured  to  assess  the  crews'  ability  to  accomplish  SAR  target  recognition 
and  designation.  Threat  densities  from  zero  to  14.  1 threats  per  minute 
occurred  during  the  SAR  target  acquisition  task. 

Analysis  of  variance  of  the  time  and  probability  measures  indicated 
that  neither  crew  size  or  threat  density  had  statistically  reliable  effects  on 
SAR  target  acquisition  performance  (p's  > 0.25).  This  is  not  an  uncommon 
finding  in  sensor  image  target  recognition  studies  with  small  sample  sizes 
because  of  the  typically  large  variability  in  such  studies.  The  SAR  target 
acquisition  results  described  below,  while  not  statistically  significant,  are 
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assumed  to  be  indicative  of  what  one  would  expect  to  occur  in  actual 
air-to-ground  radar  strike  systems. 

The  effects  of  crew  size  and  threat  density  on  median  SAR  target 
acquisition  time  are  shown  in  36.  The  two-man  crews  required  less  time  to 
recognize  and  designate  the  targets  than  the  one-man  crews  at  all  but  the 
highest  threat  density.  The  one-man  crews  required  less  time  than  the 
two- man  crews  at  the  highest  threat  density. 

Figure  37  shows  the  effects  of  crew  size  and  threat  density  on  the 
probability  of  correct  SAR  target  acquisition.  Again  the  two- man  crews 
were  superior  to  one-man  crews  at  all  but  the  highest  threat  density  where 
the  one-man  crews  were  superior. 

At  first  glance,  one  might  argue  that  at  very  high  threat  densities 
(high  workloads)  a single-man  crew  will  do  better  than  a two-man  crew  at  a 
ground  map  target  recognition  task.  This  is  not  likely  to  be  the  case.  The 
crew  coordination  problem  resulting  from  the  separation  of  RWR  threat 
detection  and  RWR  threat  response  discussed  earlier  may  have  interfered 
with  the  SAR  target  acquisition  task  at  the  highest  threat  density  and  degraded 


Figure  36.  Crew  size  and  threat  density  effects  on  time  to 
acquire  SAR  targets. 
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Figure  37.  Crew  size,  threat  density,  and 
probability  of  correct  SAR  target 
acquisition. 


SAR  target  acquisition  performance.  Thus  the  finding  that  the  one-man 
crews  were  better  than  the  two-man  crews  at  the  highest  threat  density  may 
be  an  artifact  of  the  simulation  procedures  for  RWR  threats. 

A second  and  more  likely  explanation  is  that  at  very  high  threat 
densities  the  one-man  crews  made  the  decision  to  ignore  threats  until  they 
completed  the  SAR  target  acquisition  task.  This  explanation  is  supported  by 
the  outside -cockpit  threat  detection  performance.  Out  side -cockpit  threat 
detection  probability  dropped  from  0.  59  at  12.  2 threats  per  minute  to  0.  57 
at  14.  1 treats  per  minute  for  two- man  crews.  For  one-man  crews  the  drop 
was  from  a 0.  44  to  a 0.  29  probability  of  outside- cockpit  threat  detection. 
The  rear- seat  operators  in  two-man  crews  may  also  have  made  the  decision 
to  ignore  threats  at  a high  threat  level;  however,  the  pilot  who  had  placed 
the  aircraft  on  autopilot  could  spend  100  percent  of  his  time  responding 
to  the  threats.  Though  one-man  crews  recognized  SAR  targets  better  than 
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two-man  crews  at  the  highest  threat  density,  they  sacrificed  threat  detection 
and  response  performance  to  do  so. 

The  general  effect  of  threat  density  on  SAR  target  acquisition  time 
was  to  increase  the  time  to  recognize  and  designate  targets  with  increasing 
threat  density,  except  at  the  highest  threat  level  for  the  one-man  crews. 
Increasing  workload  by  increased  threat  density  increases  the  elapsed  time 
to  complete  the  SAR  target  acquisition  task  because  the  operator  expends  more 
time  responding  to  the  threats. 

Increased  threat  density  actually  increased  the  probability  of  correct 
SAR  target  acquisition  as  threat  density  increased  from  zero  to  8.  6 threats 
per  minute  for  two- man  crews  and  for  one-man  crews  between  zero  and 
5.  5 threats  per  minute.  Further  increases  in  threat  density  caused  SAR 
target  recognition  probability  to  decrease,  except  at  the  highest  threat  level 
for  one-man  crews.  This  up-and-down  performance  variation  is  not  an 
uncommon  finding  in  behavioral  research.  Moderate  increases  in  workload 
can  cause  people  to  perform  better  at  their  assigned  tasks.  The  increased 
workload  can  have  the  effect  of  increasing  the  operators*  activation  level, 
thereby  improving  his  focus  of  attention  on  the  task  he  is  performing. 

Moderate  workloads  can  also  result  in  increased  operator  task  efficiency. 

For  example,  the  operator,  knowing  he  has  to  perform  under  increased 
workload,  may  improve  his  method  of  scanning  the  SAR  display  and  make 
better  use  of  contextual  cues,  thereby  increasing  the  probability  of  recogniz- 
ing and  designating  radar  targets. 

Large  increases  in  workload,  of  course,  can  overload  the  operators' 
capacity  and  result  in  performance  degradation.  Such  an  overload  would 
be  expected  to  occur  sooner  with  one-man  crews  than  with  two- man  crews 
in  the  simulation.  The  reduction  in  probability  of  correct  SAR  target  acquisi- 
tion that  occurred  at  8.  6 threats  per  minute  for  one-man  crews  and  12.  2 
threats  per  minute  for  two-man  crews  confirms  this  expectation. 
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SECTION  4 


CONCLUSIONS  AND  RECOMMENDATIONS 

The  simulation  study  described  in  this  report  was  conducted  to 
investigate  crew  size  requirements  for  all-weather  strike  aircraft  that  might 
employ  synthetic  aperture  radar  systems  for  air-to-ground  weapon  delivery. 
The  answer  to  the  one-versus  two-man  aircrew  issue  for  all-weather  strike 
aircraft  is  obviously  dependent  on  multiple  considerations.  Considerations 
that  were  addressed  in  the  present  research  effort  were  crew  workload  and 
crew  tasks  requiring  inside-  and  outside-cockpit  visual  scanning. 

Aircraft  flight  control  performance,  threat  detection  and  response 
performance,  and  SAR  target  acquisition  performance  for  one-  and  two-man 
crews  were  evaluated  in  the  simulation.  The  implications  of  the  results  of 
the  simulation  in  each  of  these  three  categories  of  aircrew  performance  are 
discussed  in  this  section. 

AIRCRAFT  FLIGHT  CONTROL  PERFORMANCE 

Under  low  workload,  there  was  no  difference  between  the  one-  and 
two-man  crews'  aircraft  flight  control  performance.  Under  moderate  and 
high  workloads,  two-man  crews  were  superior  to  one-man  crews  in  both  air- 
craft altitude  and  heading  control.  The  superiority  of  two-man  crews  became 
more  pronounced  as  workload  increased. 

The  flight  control  task  in  the  simulation  was  relatively  simple  in  that 
no  evasive  maneuvering  or  complex  flight  control  task,  such  as  terrain  fol- 
lowing, was  required.  An  even  greater  advantage  of  two-man  crews  would 
be  expected  for  missions  requiring  complex  flight  control  tasks. 

The  superiority  of  the  two-man  crews  during  moderate  and  high  work- 
loads in  the  simulation  may  in  part  be  due  to  the  nature  of  the  threat  detection 
and  response  tasks  that  were  used  to  vary  workload.  The  threat  detection  and 
response  tasks  required  both  rapid  response  and  outside-cockpit  visual  scan- 
ning. Boeing  (1967  and  1968)  in  their  simulation  found  no  difference  between 
one-  and  two-man  crews'  flight  control  performance:  however,  the  Boeing 
simulation  did  not  use  outside-cockpit  visual  tasks  to  vary  workload  or 
tasks  that  required  immediate  response.  Under  low  threat  environment 
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flight  conditions  where  complex  maneuvers  are  not  required,  little  advantage 
would  accrue  from  a second  crewman.  Significant  performance  improvements 
with  two-man  crews  with  regard  to  aircraft  flight  control  could  be  expected: 

1)  when  the  flight  control  task  is  complex  and  the  pilot  has  little  available  time 
for  other  tasks  as  in  terrain  following,  2)  when  considerable  outside  visual 
scanning  is  required,  as  in  high  threat  environments,  and  3)  when  major  air- 
craft systems  failures  occur. 

THREAT  DETECTION  AND  RESPONSE  PERFORMANCE 

Variation  of  crew  workload  in  the  simulation  was  accomplished  by 
presenting  different  types  of  simulated  threats  in  varying  densities.  The  dif- 
ferent types  of  threats  required  different  aircrew  responses  which  were  cate- 
gorized into  threats  that  required  in-cockpit  visual  tasks  and  out-cockpit 
visual  tasks. 

The  intent  of  the  simulation  was  to  utilize  these  simulated  threats  as 
a means  of  varying  crew  workload  that  required  both  in-cockpit  and  out- 
cockpit  tasks.  It  was  not  the  purpose  of  the  simulation  to  assess  actual  real- 
world  aircrew  threat  detection  and  response  capability:  hence,  the  simulation 
findings  should  not  be  interpreted  as  an  absolute  indication  of  one-  and  two- 
man  aircrew  performance  against  actual  threats. 

A major  and  significant  result  of  the  simulation  was  the  large 
superiority  of  two-man  crews  in  outside-cockpit  threat  detection.  The 
argument  presented  in  the  Navy  position  paper  that  advantages  of  a two-man 
aircraft  accrue  primarily  because  1)  the  two-man  crew  can  sight  and  acquire 
targets  quickly  while  maintaining  six  o'clock  surveillance  and  SAM  lookout 
and  (2)  the  ability  of  the  second  crew  member  to  concentrate  attention  on 
sophisticated  multiple  target  threats  and  ECM  while  the  pilot  flies  the  air- 
craft and  maintains  the  essential  visual  surveillance  were  shown  to  be  valid. 

The  lack  of  an  appreciable  advantage  in  the  detection  and  response  to 
inside-cockpit  threats  by  two-man  crews  is  in  agreement  with  the  findings  of 
the  Boeing  (1967  and  1968)  simulation  where  it  was  found  that  a one-man 
crew  can  perform  standard  flight  systems  management  tasks  as  effectively 
as  a two-man  crew. 
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A major  conclusion  that  can  be  derived  from  the  simulation  is  that  a 
two-man  crew  will  be  able  to  maintain  outside  visual  surveillance  over  a 
large  volume  of  space  far  better  than  a one-man  crew.  The  implications  of 
this  conclusion  for  aircraft/crew  survival  in  hostile  environments  are 
obvious . 

SYNTHETIC  APERTURE  RADAR  TARGET  ACQUISITION  PERFORMANCE 

At  the  zero  threat  level,  the  two-man  crews  were  slightly  superior  to 
one-man  crews  in  the  time  (5  seconds  faster)  required  to  recognize  and  desig- 
nate SAR  targets  and  the  probability  (5  percent  higher)  of  correctly  recogniz- 
ing and  designating  the  SAR  targets.  Since  in  the  SAR  target  acquisition 
phase  at  zero  threat  density  there  were  no  other  tasks  (no  flight  control  and 
no  threats),  it  must  be  concluded  that  the  rear-seat  operators  used  in  the 
simulation  were  superior  to  the  one-man  crew  pilots  in  their  ability  to 
recognize  and  designate  targets  on  SAR  ground  maps.  As  threat  density 
increased,  the  two-man  crews’  SAR  target  acquisition  performance  degrada- 
tion was  slightly  less  than  for  one-man  crews.  Thus,  there  is  a slight 
advantage  in  favor  of  the  two-man  crew  in  SAR  target  acquisition  performance 
with  moderate  workloads.  The  finding  is  in  agreement  with  the  Boeing  (1967 
and  1968)  simulation  in  which  two-man  crews  visually  acquired  prebriefed 
ground  targets  sooner  than  one-man  crews. 

The  superiority  of  one-man  crews  at  the  highest  threat  density  which 
was  caused  by  the  one-man  crews  ignoring  outside-cockpit  threats  until  the 
SAR  target  task  had  been  completed  is  of  considerable  importance.  When  an 
aircraft  is  in  range  for  air-to-ground  target  acquisition  to  occur,  the  threat 
density  in  hostile  environments  will  be  the  highest.  While  two-man  crews 
could  maintain  outside  visual  surveillance  during  the  SAR  target  acquisition 
phase  at  the  highest  threat  density,  the  one-man  crews  could  not.  Thus  one- 
man  crews  can  perform  air-to-ground  SAR  target  acquisition  at  high  work- 
loads effectively  only  if  they  sacrifice  outside -cockpit  visual  tasks. 

The  principal  advantage  of  a two-man  crew  is  for  outside -cockpit 
visual  surveillance.  Some  improvement  of  flight  control  and  air-to-ground 
target  acquisition  performance  under  moderate  to  heavy  workload  may  be 
expected  with  two-man  aircraft;  however,  the  performance  improvement  does 
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not  appear  to  be  substantial.  The  key  argument  for  a two- place  SAR 
air-to-ground  strike  aircraft,  therefore,  is  the  increased  survivability  in 
hostile  environments  by  virtue  of  increased  visual  surveillance  and  detection 
of  threats.  Two-man  aircraft,  however,  are  more  expensive,  require 
greater  manpower,  and  larger  training  programs  than  do  single-place  air- 
craft. In  the  final  analysis,  cost  must  be  traded  against  aircraft  survivabil- 
ity in  hostile  environments. 

RECOMMENDATIONS  FOR  FUTURE  CREW  SIZE  RESEARCH 
Total  System  Considerations 

The  present  study  examined  various  components  of  crew  performance 
over  a wide  range  of  crew  tasks  and  task  loading.  In  general,  the  results 
demonstrated  an  increase  d capability  with  the  addition  of  a second  crew  mem- 
ber. It  does  not  necessarily  follow,  however,  that  the  improved  crew  per- 
formance will  result  in  a system  that  more  effectively  meets  the  objectives 
of  the  mission.  Total  system  performance,  judged  in  terms  of  the  mission, 
combined  with  cost  provides  the  ultimate  criterion  by  which  a one-  versus 
two-man  crew  decision  must  be  made. 

For  example,  the  aerodynamic  capability  of  a two-man  aircraft  may 
be  less  than  that  of  a one-man  aircraft,  and  it  is  possible  for  this  reduced 
aircraft  performance  to  offset  any  gain  in  crew  performance  resulting  from 
the  second  crew  member.  On  the  other  hand,  it  may  be  that  for  the  intended 
mission  the  reduced  aircraft  performance  is  of  little  consequence.  Only  by  a 
careful  analysis  of  the  mission  requirements  and  system  capabilities  can  the 
full  impact  of  crew  size  be  determined. 

The  cost  impact  of  crew  size  can  be  considerable.  Two-man  aircraft 
can  be  expected  to  have  a higher  initial  cost  and  recurring  maintenance  costs 
will  be  higher  because  of  the  increased  complexity  of  the  two-man  cockpit 
configuration.  By  doubling  the  number  of  crewmen,  costs  of  training  and 
proficiency  maintenance  will  rise  substantially  as  will  costs  for  salaries, 
dependents,  and  the  increased  number  of  support  personnel.  All  of  these 
additional  costs  must  be  weighed  against  the  benefit  of  increased  aircraft  sur- 
vivability likely  to  result  from  a two-man  crew. 
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Many  other  system  performance  parameters  can  and  should  be 
identified  and  their  cost  impact  assessed.  The  interactions  among  these 
various  parameters  also  need  to  be  identified  and  integrated  into  a system 
performance  and  cost  prediction  equation.  Data  for  this  portion  of  a pre- 
diction equation  can  be  obtained,  to  a major  extent,  by  analysis  and  examina 
tion  of  existing  systems  and  their  history.  An  assessment  of  the  impact  and 
interaction  of  these  system  variables  on  crew  performance  and  of  crew  per- 
formance on  total  system  effectiveness  will  require  additional  behavioral 
research. 

Man-Machine  System  Model 

To  facilitate  this  research  a conceptual  model  of  the  man  and  the 
machine  is  needed.  Initially  this  model  can  be  global  and  relatively  simple; 
however,  as  the  understanding  of  the  human  operator  improves  the  model 
will  have  to  become  increasingly  sophisticated.  A possible  global  model  of 
the  man- machine  system  is  shown  in  Figure  38  which  indicates  that  from  a 
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Figure  38.  Man-machine  system  model. 


systems  standpoint  both  the  man  and  the  machine  share  common  character- 
istics. Both  have  input  and  output  mechanisms  separated  by  a processing 
element. 

A major  difference  lies  in  the  accessibility  of  the  various  elements  to 
manipulation  by  the  system  designer.  All  of  the  elements  and  links  in  the 
machine  can  be  readily  modified  but  the  characteristics  of  the  operator  are 
relatively  fixed  and  can  only  be  slightly  modified  through  training.  This,  of 
course,  does  not  mean  that  the  operator's  performance  cannot  be  influenced 
by  the  system  designer.  On  the  contrary,  major  differences  can  be  effected 
by  manipulating  the  machine  and  the  two  links  between  the  man  and  the 
machine.  If  the  links  are  optimized,  then  maximum  communication  between 
the  man  and  the  machine  can  result.  Further,  if  the  processing  tasks 
required  of  the  man  are  those  for  which  he  is  best  suited,  then  maximum 
human  information  processing  can  be  achieved. 

If  the  system  designer  is  to  accomplish  this  goal  of  an  optimum  system, 
an  adequate  model  and  understanding  of  the  human  operator  will  be  necessary. 
Considerable  work  has  already  been  accomplished  in  this  direction,  and  the 
model  of  Figure  38  can  be  expanded  to  reflect  knowledge  concerning  selective 
attention,  short  term  memory,  sensory  encoding,  decision  processes, 
response  selection,  feedback  mechanisms,  and  so  on.  This  work  needs  to 
continue  and  can  best  be  accomplished  in  a laboratory  setting  where  the  vari- 
ous elements  and  links  can  be  isolated  and  manipulated.  Once  an  adequate 
model  of  the  operator  has  been  obtained,  optimum  allocation  of  tasks  to  the 
man  and  the  machine  can  be  made  and  the  communication  between  the  two 
maximized. 

With  an  understanding  of  a single  crewman  man-machine  system,  the 
model  can  be  expanded  to  include  a second  crewman  and  other  elements  of 
the  total  system.  For  example,  the  addition  of  a second  crewman  will  increase 
the  number  of  possible  communication  links.  In  addition  to  man-machine 
links,  man-man,  and  machine-machine  links  will  also  be  of  importance. 

For  example,  suppose  that  the  second  crew  member  were  added  as  a 
total  duplication  of  the  first  crewman,  including  a second  machine  for  him  to 
operate.  In  this  case  the  second  operator  would  be  in  parallel  with  the  first 
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and  a slight  improvement  in  system  performance  could  be  expected  because 
of  the  redundancy  in  operation.  This  of  course  is  a highly  inefficient  method 
of  using  the  second  crew  member, 

A potentially  better  utilization  could  be  made  by  establishing  the 
appropriate  communication  links  and  allocating  different  portions  of  the  task 
to  each  operator.  One  operator  would  have  one  set  of  primary  and  secondary 
tasks  and  the  other  operator  a complimentary  set  of  tasks  and  priorities.  In 
this  way  each  operator  could  function  at  a lower  workload  and  still  provide  a 
mechanism  for  redundancy.  The  presence  of  these  additonal  communication 
links  does  not  guarantee  more  efficient  operation,  however.  It  is  possible 
for  an  inappropriately  used  link  to  become  overloaded  with  a resultant 
decrease  in  performance  as  occurred  with  two- man  crews  at  the  highest 
threat  density  in  the  present  study.  Knowledge  of  the  capabilities  of  the  vari- 
ous communication  links  is  a necessity. 

Model  Validity 

A model  of  human  performance  must  have  both  internal  and  external 
validity.  Internal  validity  means  that  the  model  is  interpretable,  consistent, 
and  correctly  separates  the  various  elements  and  their  functions.  External 
validity  means  that  the  model  is  generalizable  and  predicts  to  situations  that 
have  not  been  directly  tested.  Internal  validity  is  most  easily  achieved  in  a 
laboratory  situation  where  good  experimental  control  allows  only  those  proc- 
esses under  investigation  to  vary.  External  validity  can  only  be  determined 
by  testing  the  model  in  realistic  situations  to  insure  that  it  will  generalize 
correctly.  The  optimum  research  strategy  to  insure  both  internal  and  exter- 
nal validity  will  involve  basic  laboratory  studies  coupled  with  simulations  at 
various  levels  of  sophistication  and  actual  field  evaluations.  The  laboratory 
work  would  develop  the  basic  model  which  would  be  verified  using  simulations. 
The  more  realistic  simulations  would  also  provide  insight  into  aspects  of  per- 
formance not  included  in  the  model  under  test.  These  insights  would  then  pro- 
vide a basis  for  model  expansion,  again  taking  advantage  of  the  controlled 
laboratory  setting.  By  means  of  an  interactive  and  iterative  use  of  both 
avenues  of  research  a model  with  high  internal  and  external  validity  could  be 
made  available  to  the  system  planner  who  must  decide  how  many  crew  mem- 
bers are  required. 
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APPENDIX  A 


SAR  TARGET  TEST  SCENES  USED 
IN  THE  SIMULATION 
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Figure  A- T.  Test  Target  Number  1 

Target  consisted  of  10  vehicles 
arranged  in  a convoy  formation 
with  approsdmately  100  foot  spac- 
ing. The  target  was  located  in  a 
rectangular  clearing.  The  area 
is  heavily  wooded. 


Figure  A-2.  Test  Target  Number  2 

Target  was  a headquarters  and 
supply  area  in  a heavily  wooded 
area.  A large  concentration  of 
vehicles  was  located  in  a large 
clearing  approximately  1500  meters 
below  the  main  target  complex. 
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Figure  A- 5.  Test  Target  Number  5 

Target  was  a single  tank  parked 
at  a road  junction  1200  meters 
north  of  a small  town. 
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Figure  A-6.  Test  Target  Number  6 

Target  was  a small  bridge  cross- 
ing a river.  Several  vehicles 
are  proceeding  towards  the 
bridge  approximately  1 500 
meters  to  the  east. 
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Figure  A-7.  Test  Target  Number  7 


Target  is  a AAA  battery  located 
above  the  airfield  runway  adjacent 
to  a chain  link  fence. 


Figure  A- 8.  Test  Target  Number  8 

Target  is  the  control  tower  above 
and  near  the  center  of  a dirt 
airstrip. 
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Figure  A- 9.  Test  Target  Number  9 

Target  is  a small  supply  depot  (100 
by  600  meters)  in  a wooded  area. 
Target  is  located  1000  meters 
above  bend  in  river. 


Figure  A- 10.  Test  Target 
Number  10 

Target  is  a rectangular  storage 
depot  (100  by  400  meters)  with  a 
chain  link  fence.  Target  is  located 
500  meters  east  of  a small  town 
above  a road. 
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ANALYSIS  OF  VARIANCE 
SUMMARY  TABLES 
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TABLE  B- 

Source  of  Error 

Variance  Term 

1.  ANALYSIS  OF  VARIANCE 
ALTITUDE  CONTROL 

Deg  rees 

Sum  of  of 

F- Ratio  Squares  Freedom 

■ 

- 

FOR  AIRCRAFT 
Mean  Square  Probability 

Mission 

Phase  (P) 

PS(C) 

36. 1816 

6045. 883 

1 

6045.883 

<0.00  1 ? 

Threat 

Density  (T) 

TS(C) 

6.4057 

859. 8848 

3 

286.6282 

‘0,00  1 

Crew  Size  (C) 

S(C) 

11.6  180 

3291.673 

1 

3291.673 

■ 0.  00  1 

Subjects  S(C) 

5099.855 

18 

283. 3252 

PT 

PTS(C) 

6. 3535 

980,6621 

3 

326.8872 

‘0.00  1 

PC 

PS(C) 

20. 0094 

3343. 534 

1 

3343. 534 

<0.001 

TC 

TS(C) 

1.4672 

196. 9583 

3 

65.65274 

'0.20 

PS(C) 

3007.770 

18 

167. 0983 

TS(C) 

2416. 272 

54 

44,74577 

PTC 

PTS(C) 

1.6716 

258. 0093 

3 

86.00308 

0.  10  < 0,  20 

PTS(C) 

2778.  301 

54 

51.45000 

■= 

TABLE  B- 

2.  ANALYSIS  OF  VARIANCE 

FOR  AIRCRAFT  I 

HEADING  CONTROL 

Degrees 

Source  of 

Error 

Sum  of 

of 

Variance 

Term 

F - Ratio 

Squares 

Freedom 

Mean  Square 

Probability 

Mission 

Phase  (!’) 

PS(C) 

15. 9116 

887. 9741 

1 

887.  9741 

<0.001 

Threat 

Density  (T) 

TS(C) 

2. b026 

174. 1530 

3 

48.  05099 

0.01  < 0.05 

Crew  Si  ^e  (C) 

S(C) 

7.5836 

421.6243 

1 

421.6243 

0.01  . 0.05 

Subjects  S(C) 

1000. 741 

18 

55.59671 

PT 

PTS(C) 

3. 0020 

179. 5640 

3 

59. 85468 

0.01  V 0.05  ' 

PC 

PS(C) 

7.6912 

429,2187 

1 

429.  2 187 

0.  0 1 ■ 0.  05 

TC 

TS(C) 

1 .2816 

76. 89429 

3 

25.63142 

■0.  25 

PS(C) 

1004. 521 

18 

55. 80672 

TS(C) 

107b. 968 

54 

19. UQQ40 

PTC 

PTS(C) 

1.2515 

74,85840 

3 

24. M527U 

0.  25  i 

FTS(C) 

1076, 660 

54 

lb. 03814 

1 
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TABLE  B-3.  ANALYSIS  OF  VARIANCE  FOR  RWR  THREAT 


RESPONSE  PROBABILITY 

Degrees 


Source  of 

E r ro  r 

Sum  of 

of 

Variance 

Te  rm 

F- Ratio 

Squares  Freedom 

Mean  Square 

Probability 

Mission 
Phase  (P) 

PS(C) 

13. 5918 

0.2665066 

1 

0. 2665066 

0.001  < 0.01 

Threat 
Density  (T) 

TS(C) 

51.6257 

1.756146 

3 

0. 5853821 

<0.  00  1 

Crew  Size  (C) 

S(C) 

0. 0722 

0. 2325862E-02 

1 

0.  2325862E-02 

-0.  025 

Subjects  S(C) 

0. 5795606 

18 

0.  3219781E-01 

PT 

PTS(C) 

3.6131 

0. 1396189 

3 

0.4653962E-01 

0.01  < 0.05 

PC 

i>S(C) 

0. 6325 

0.  1240209E-01 

1 

0.  124C209E-01 

<0.  25 

TC 

TS(C) 

2.3795 

0.  8094418E-0I 

3 

0.2698139E-01 

0.  05  < 0.  10 

PS(  C) 

0. 3529432 

18 

0.  1960796E-01 

TS(C) 

0.6123042 

54 

0.  1 133896E-01 

I ’TC 

PTS(C) 

1.  363‘> 

0.  5270427E-0I 

3 

0.  1756809E-01 

<0.25 

PTS(C) 

0.  6<'55605 

54 

0. 1288075E-01 

TABLE 

B-4. 

ANALYSIS 

OF  VARIANCE 

FOR  RWR  OUTSIDE 

LIGHTS 

DETECTION  PROBABILITY 


Source  of 
Variance 

E rro  r 
Term 

F-  Ratio 

Sum  of 
Squares 

Degrees 

of 

Freedom 

Mean  Square 

Probability 

Mission 
Phase  (P) 

PS(C) 

19. 3670 

0. 3376200 

1 

0.  3376200 

<0.  001 

Threat 
Density  (T) 

TS(C) 

12. 01 1 1 

1. 263977 

3 

0.  42  13257 

..0.001 

Crew  Size 

S(C) 

6.  0342 

1. 219752 

1 

1.219752 

0.01  0.05 

Subjects  S(C) 

3. 63845 

18 

0.  202  1413 

PT 

PTS(C) 

2. 3570 

0. 1881485 

3 

0.6271613E-01 

0. 20  V 0. 10 

I’C 

PS(C) 

0.  1898 

0.  3308296E-02 

1 

0.  3308296E-02 

■0.  25 

TC 

TS(C) 

0.4849 

0.  51031 1 lE-OI 

3 

0.  1701037E-01 

■0.  25 

PS(C) 

0. 3137894 

18 

0.  1743274E-01 

TS(C) 

1. 8942 15 

54 

0.  3507805E-01 

PTC 

PTS(C) 

0.  77>'2 

0. 6220245E-0 1 

3 

0.  2073415E-01 

■0.  25 

PTS(C) 

1. 436853 

54 

0.  2660840E-0  1 
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TABLE  B-5.  ANALYSIS  OF  VARIANCE  FOR  NON-RWR  OUTSIDE 
LIGHTS  DETECTION  PROBABILITY 


Source  of 
Variance 

Error 

Term 

F- Ratio 

Sum  of 
Squares 

Degrees 

of 

Freedom 

Mean  Square 

Probability 

Mission 
Phase  (P) 

PS(C) 

1.4004 

0.7526428E-01 

1 

0.  7526428E-01 

0.  25 

Threat 
Density  (T) 

TS(C) 

7.7255 

0. 9557392 

3 

0. 3185797 

< 0. 001 

Crew  Size  (C) 

S(C) 

21.8274 

3. 066355 

1 

3. 066355 

<0,00  1 

Subjects  S(C) 

2. 528669 

18 

0.  1404816 

PT 

PTS(C) 

1.7021 

0. 154741 1 

3 

0. 5158037E-01 

0.  10  < 0. 20 

PC 

PS(C) 

0.7919 

0.  4256248E-01 

1 

0. 4256248E-01 

>0.25 

TC 

TS(C) 

2.  3052 

0,2841791 

3 

0.  9505969E-01 

0.  05  < 0.  10 

PS(C) 

0. 9674387 

18 

0.  5374659E-01 

TS(C) 

2, 226824 

54 

0.4123748E-01 

PTC 

PTS(C) 

1.4015 

0.  1274177 

3 

0.  4247258E-01 

0.25 

PTS(C) 

1.636447 

54 

0.  3030457E-01 

TABLE  B-6.  ANALYSIS  OF  VARIANCE  FOR  AIR-TO-AIR  RADAR 
TARGET  DETECTION  PROBABILITY 


Source  of 
Variance 

E rror 
Term 

F- Ratio 

Sum  of 
Squares 

Degrees 

of 

Freedom 

Mean  Square 

Probability 

Threat 
Density  (T) 

TS(C) 

30,2224 

1. 586267 

3 

0. 5287558 

<0.001 

Crew  Size  (C) 

S(C) 

0. 0097 

0. 1240332E-02 

1 

0.  1240332E-02 

>0.  25 

Subjects  S(C) 

2. 304596 

18 

0,  1280331 

TC 

TS(C) 

2.5532 

0. 1340097 

3 

0.  4466 99 OE- 01 

0.  05  0.  10 

TS(C) 

0, 9447571 

54 

0.  I749550E-01 

TABLE  B-7.  ANALYSIS  OF  VARIANCE  FOR  SYNTHETIC  APERTURE 
RADAR  TARGET  ACQUISITION  TIME 


Degrees 


Source  of 
Variance 

Error 

Term 

F- Ratio 

Sum  of 
Squares 

of 

Freedom 

Mean  Square 

Probability 

Threat  (T) 

TS(C) 

1.0667 

5628.887 

4 

1407.222 

>0.25 

Trials  (L) 

LS(C) 

1.6035 

1217.672 

1 

1217.672 

0.  25  < 0.20 

Crew  Size  (C) 

S(C) 

0.7299 

1429.432 

1 

1429.432 

>0.25 

Subjects  S(C) 

35252.73 

18 

1958.485 

TL 

TLS(C) 

1.5595 

5100.457 

4 

1275.  114 

0.25  < 0.20 

TC 

TS(C) 

0.  1985 

1047.307 

4 

261.8267 

>0.25 

LC 

LS(C) 

0.  9525 

723.2847 

1 

723.2847 

>0.  25 

TS(C) 

94984.69 

72 

1319. 232 

LS(C) 

13669.01 

18 

759.3892 

TLC 

TLS(C) 

1.2425 

4063.454 

4 

1015.863 

>0.25 

TLS(C) 

58869.  16 

72 

817.6272 

!r 
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